2023-07-17 02:11:06,275 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-17 02:11:06,566 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f 2023-07-17 02:11:06,567 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-17 02:11:06,618 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-17 02:11:06,938 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-17 02:11:06,939 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02, deleteOnExit=true 2023-07-17 02:11:06,939 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-17 02:11:06,940 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/test.cache.data in system properties and HBase conf 2023-07-17 02:11:06,941 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 02:11:06,941 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop.log.dir in system properties and HBase conf 2023-07-17 02:11:06,942 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 02:11:06,942 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 02:11:06,942 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 02:11:07,348 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-17 02:11:07,355 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 02:11:07,356 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 02:11:07,357 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 02:11:07,357 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 02:11:07,357 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 02:11:07,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 02:11:07,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 02:11:07,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 02:11:07,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 02:11:07,360 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/nfs.dump.dir in system properties and HBase conf 2023-07-17 02:11:07,360 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir in system properties and HBase conf 2023-07-17 02:11:07,361 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 02:11:07,361 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 02:11:07,361 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-17 02:11:07,994 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 02:11:07,999 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 02:11:08,380 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-17 02:11:08,619 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-17 02:11:08,632 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 02:11:08,677 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 02:11:08,732 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir/Jetty_localhost_39267_hdfs____.6guakp/webapp 2023-07-17 02:11:08,908 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39267 2023-07-17 02:11:08,920 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 02:11:08,921 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 02:11:09,528 WARN [Listener at localhost/39797] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 02:11:09,656 WARN [Listener at localhost/39797] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 02:11:09,680 WARN [Listener at localhost/39797] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 02:11:09,746 INFO [Listener at localhost/39797] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 02:11:09,756 INFO [Listener at localhost/39797] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir/Jetty_localhost_39541_datanode____14schf/webapp 2023-07-17 02:11:09,895 INFO [Listener at localhost/39797] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39541 2023-07-17 02:11:10,502 WARN [Listener at localhost/37133] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 02:11:10,601 WARN [Listener at localhost/37133] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 02:11:10,606 WARN [Listener at localhost/37133] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 02:11:10,608 INFO [Listener at localhost/37133] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 02:11:10,619 INFO [Listener at localhost/37133] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir/Jetty_localhost_45883_datanode____hwjwft/webapp 2023-07-17 02:11:10,757 INFO [Listener at localhost/37133] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45883 2023-07-17 02:11:10,782 WARN [Listener at localhost/40593] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 02:11:10,881 WARN [Listener at localhost/40593] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 02:11:10,891 WARN [Listener at localhost/40593] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 02:11:10,897 INFO [Listener at localhost/40593] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 02:11:10,911 INFO [Listener at localhost/40593] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir/Jetty_localhost_34019_datanode____.o0kv9e/webapp 2023-07-17 02:11:11,056 INFO [Listener at localhost/40593] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34019 2023-07-17 02:11:11,077 WARN [Listener at localhost/37735] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 02:11:11,384 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x26e3111fee0cedc4: Processing first storage report for DS-107943c4-e77e-4ed4-909a-a14e55962174 from datanode 8fe82f18-0362-49c7-9100-7f91aeaad1b2 2023-07-17 02:11:11,386 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x26e3111fee0cedc4: from storage DS-107943c4-e77e-4ed4-909a-a14e55962174 node DatanodeRegistration(127.0.0.1:38869, datanodeUuid=8fe82f18-0362-49c7-9100-7f91aeaad1b2, infoPort=46101, infoSecurePort=0, ipcPort=37133, storageInfo=lv=-57;cid=testClusterID;nsid=21495292;c=1689559868106), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-17 02:11:11,387 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x26e3111fee0cedc4: Processing first storage report for DS-63912397-4c4b-4e23-84bb-409e577b6bc1 from datanode 8fe82f18-0362-49c7-9100-7f91aeaad1b2 2023-07-17 02:11:11,387 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x26e3111fee0cedc4: from storage DS-63912397-4c4b-4e23-84bb-409e577b6bc1 node DatanodeRegistration(127.0.0.1:38869, datanodeUuid=8fe82f18-0362-49c7-9100-7f91aeaad1b2, infoPort=46101, infoSecurePort=0, ipcPort=37133, storageInfo=lv=-57;cid=testClusterID;nsid=21495292;c=1689559868106), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 02:11:11,387 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc45288a4fe3f6d5d: Processing first storage report for DS-7b6f4735-a654-4f78-9066-a61d339b75e8 from datanode cc15a7be-f64b-4d2b-9da3-d815580ae8fe 2023-07-17 02:11:11,387 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc45288a4fe3f6d5d: from storage DS-7b6f4735-a654-4f78-9066-a61d339b75e8 node DatanodeRegistration(127.0.0.1:36471, datanodeUuid=cc15a7be-f64b-4d2b-9da3-d815580ae8fe, infoPort=37323, infoSecurePort=0, ipcPort=37735, storageInfo=lv=-57;cid=testClusterID;nsid=21495292;c=1689559868106), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 02:11:11,387 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7df3153c2d2c55ad: Processing first storage report for DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3 from datanode c751f552-7b8f-4600-b432-03bf33f7049a 2023-07-17 02:11:11,387 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7df3153c2d2c55ad: from storage DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3 node DatanodeRegistration(127.0.0.1:37873, datanodeUuid=c751f552-7b8f-4600-b432-03bf33f7049a, infoPort=35797, infoSecurePort=0, ipcPort=40593, storageInfo=lv=-57;cid=testClusterID;nsid=21495292;c=1689559868106), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 02:11:11,388 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc45288a4fe3f6d5d: Processing first storage report for DS-d78cbb9b-1447-4ae1-80b2-4f798f9137a3 from datanode cc15a7be-f64b-4d2b-9da3-d815580ae8fe 2023-07-17 02:11:11,388 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc45288a4fe3f6d5d: from storage DS-d78cbb9b-1447-4ae1-80b2-4f798f9137a3 node DatanodeRegistration(127.0.0.1:36471, datanodeUuid=cc15a7be-f64b-4d2b-9da3-d815580ae8fe, infoPort=37323, infoSecurePort=0, ipcPort=37735, storageInfo=lv=-57;cid=testClusterID;nsid=21495292;c=1689559868106), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 02:11:11,388 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7df3153c2d2c55ad: Processing first storage report for DS-eb4d6828-c419-4a7b-ad82-3af71e54069e from datanode c751f552-7b8f-4600-b432-03bf33f7049a 2023-07-17 02:11:11,388 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7df3153c2d2c55ad: from storage DS-eb4d6828-c419-4a7b-ad82-3af71e54069e node DatanodeRegistration(127.0.0.1:37873, datanodeUuid=c751f552-7b8f-4600-b432-03bf33f7049a, infoPort=35797, infoSecurePort=0, ipcPort=40593, storageInfo=lv=-57;cid=testClusterID;nsid=21495292;c=1689559868106), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 02:11:11,664 DEBUG [Listener at localhost/37735] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f 2023-07-17 02:11:11,774 INFO [Listener at localhost/37735] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/zookeeper_0, clientPort=62514, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-17 02:11:11,809 INFO [Listener at localhost/37735] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62514 2023-07-17 02:11:11,820 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:11,827 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:12,549 INFO [Listener at localhost/37735] util.FSUtils(471): Created version file at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 with version=8 2023-07-17 02:11:12,549 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/hbase-staging 2023-07-17 02:11:12,960 INFO [Listener at localhost/37735] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-17 02:11:13,579 INFO [Listener at localhost/37735] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 02:11:13,614 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:13,615 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:13,615 INFO [Listener at localhost/37735] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 02:11:13,615 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:13,616 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 02:11:13,824 INFO [Listener at localhost/37735] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 02:11:13,932 DEBUG [Listener at localhost/37735] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-17 02:11:14,066 INFO [Listener at localhost/37735] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40829 2023-07-17 02:11:14,081 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:14,083 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:14,108 INFO [Listener at localhost/37735] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40829 connecting to ZooKeeper ensemble=127.0.0.1:62514 2023-07-17 02:11:14,195 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:408290x0, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 02:11:14,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40829-0x101710c34000000 connected 2023-07-17 02:11:14,247 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 02:11:14,250 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 02:11:14,263 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 02:11:14,271 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40829 2023-07-17 02:11:14,272 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40829 2023-07-17 02:11:14,273 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40829 2023-07-17 02:11:14,273 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40829 2023-07-17 02:11:14,274 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40829 2023-07-17 02:11:14,281 INFO [Listener at localhost/37735] master.HMaster(444): hbase.rootdir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1, hbase.cluster.distributed=false 2023-07-17 02:11:14,363 INFO [Listener at localhost/37735] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 02:11:14,363 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:14,363 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:14,363 INFO [Listener at localhost/37735] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 02:11:14,363 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:14,363 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 02:11:14,369 INFO [Listener at localhost/37735] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 02:11:14,379 INFO [Listener at localhost/37735] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37335 2023-07-17 02:11:14,383 INFO [Listener at localhost/37735] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 02:11:14,393 DEBUG [Listener at localhost/37735] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 02:11:14,395 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:14,398 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:14,400 INFO [Listener at localhost/37735] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37335 connecting to ZooKeeper ensemble=127.0.0.1:62514 2023-07-17 02:11:14,410 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:373350x0, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 02:11:14,412 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): regionserver:373350x0, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 02:11:14,415 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): regionserver:373350x0, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 02:11:14,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37335-0x101710c34000001 connected 2023-07-17 02:11:14,417 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 02:11:14,423 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37335 2023-07-17 02:11:14,423 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37335 2023-07-17 02:11:14,424 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37335 2023-07-17 02:11:14,426 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37335 2023-07-17 02:11:14,427 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37335 2023-07-17 02:11:14,442 INFO [Listener at localhost/37735] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 02:11:14,443 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:14,443 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:14,444 INFO [Listener at localhost/37735] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 02:11:14,444 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:14,444 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 02:11:14,444 INFO [Listener at localhost/37735] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 02:11:14,460 INFO [Listener at localhost/37735] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35673 2023-07-17 02:11:14,461 INFO [Listener at localhost/37735] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 02:11:14,465 DEBUG [Listener at localhost/37735] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 02:11:14,466 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:14,469 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:14,473 INFO [Listener at localhost/37735] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35673 connecting to ZooKeeper ensemble=127.0.0.1:62514 2023-07-17 02:11:14,487 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:356730x0, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 02:11:14,489 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): regionserver:356730x0, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 02:11:14,490 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): regionserver:356730x0, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 02:11:14,491 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): regionserver:356730x0, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 02:11:14,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35673-0x101710c34000002 connected 2023-07-17 02:11:14,503 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35673 2023-07-17 02:11:14,503 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35673 2023-07-17 02:11:14,509 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35673 2023-07-17 02:11:14,510 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35673 2023-07-17 02:11:14,510 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35673 2023-07-17 02:11:14,524 INFO [Listener at localhost/37735] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 02:11:14,525 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:14,525 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:14,525 INFO [Listener at localhost/37735] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 02:11:14,525 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 02:11:14,525 INFO [Listener at localhost/37735] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 02:11:14,525 INFO [Listener at localhost/37735] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 02:11:14,527 INFO [Listener at localhost/37735] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45215 2023-07-17 02:11:14,528 INFO [Listener at localhost/37735] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 02:11:14,535 DEBUG [Listener at localhost/37735] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-17 02:11:14,536 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:14,539 INFO [Listener at localhost/37735] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:14,546 INFO [Listener at localhost/37735] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45215 connecting to ZooKeeper ensemble=127.0.0.1:62514 2023-07-17 02:11:14,553 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:452150x0, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 02:11:14,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45215-0x101710c34000003 connected 2023-07-17 02:11:14,555 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 02:11:14,557 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 02:11:14,558 DEBUG [Listener at localhost/37735] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 02:11:14,563 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45215 2023-07-17 02:11:14,563 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45215 2023-07-17 02:11:14,566 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45215 2023-07-17 02:11:14,567 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45215 2023-07-17 02:11:14,567 DEBUG [Listener at localhost/37735] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45215 2023-07-17 02:11:14,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:11:14,585 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 02:11:14,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:11:14,611 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 02:11:14,611 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 02:11:14,611 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 02:11:14,611 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 02:11:14,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:11:14,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 02:11:14,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40829,1689559872752 from backup master directory 2023-07-17 02:11:14,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 02:11:14,620 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:11:14,620 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 02:11:14,621 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 02:11:14,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:11:14,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-17 02:11:14,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-17 02:11:14,751 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/hbase.id with ID: 23e9833c-e5f6-47ff-b2d7-42e7a39f4e09 2023-07-17 02:11:14,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 02:11:14,834 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:11:14,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2b2db392 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:14,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ffb8727, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:14,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 02:11:14,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-17 02:11:15,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-17 02:11:15,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-17 02:11:15,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 02:11:15,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 02:11:15,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 02:11:15,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/data/master/store-tmp 2023-07-17 02:11:15,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:15,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 02:11:15,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 02:11:15,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 02:11:15,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 02:11:15,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 02:11:15,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 02:11:15,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 02:11:15,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/WALs/jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:11:15,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40829%2C1689559872752, suffix=, logDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/WALs/jenkins-hbase4.apache.org,40829,1689559872752, archiveDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/oldWALs, maxLogs=10 2023-07-17 02:11:15,225 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK] 2023-07-17 02:11:15,226 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK] 2023-07-17 02:11:15,225 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK] 2023-07-17 02:11:15,237 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-17 02:11:15,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/WALs/jenkins-hbase4.apache.org,40829,1689559872752/jenkins-hbase4.apache.org%2C40829%2C1689559872752.1689559875150 2023-07-17 02:11:15,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK], DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK], DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK]] 2023-07-17 02:11:15,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-17 02:11:15,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:15,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 02:11:15,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 02:11:15,415 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-17 02:11:15,422 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-17 02:11:15,457 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-17 02:11:15,471 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:15,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 02:11:15,478 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 02:11:15,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 02:11:15,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:11:15,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73712578, jitterRate=0.09840300679206848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:11:15,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 02:11:15,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-17 02:11:15,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-17 02:11:15,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-17 02:11:15,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-17 02:11:15,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-17 02:11:15,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 51 msec 2023-07-17 02:11:15,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-17 02:11:15,637 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-17 02:11:15,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-17 02:11:15,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-17 02:11:15,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-17 02:11:15,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-17 02:11:15,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-17 02:11:15,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-17 02:11:15,717 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:11:15,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-17 02:11:15,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-17 02:11:15,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-17 02:11:15,748 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 02:11:15,749 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 02:11:15,749 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 02:11:15,749 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 02:11:15,749 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:11:15,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40829,1689559872752, sessionid=0x101710c34000000, setting cluster-up flag (Was=false) 2023-07-17 02:11:15,777 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:11:15,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-17 02:11:15,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:11:15,794 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:11:15,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-17 02:11:15,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:11:15,808 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp 2023-07-17 02:11:15,884 INFO [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(951): ClusterId : 23e9833c-e5f6-47ff-b2d7-42e7a39f4e09 2023-07-17 02:11:15,887 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(951): ClusterId : 23e9833c-e5f6-47ff-b2d7-42e7a39f4e09 2023-07-17 02:11:15,894 DEBUG [RS:1;jenkins-hbase4:35673] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 02:11:15,900 DEBUG [RS:0;jenkins-hbase4:37335] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 02:11:15,905 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(951): ClusterId : 23e9833c-e5f6-47ff-b2d7-42e7a39f4e09 2023-07-17 02:11:15,907 DEBUG [RS:2;jenkins-hbase4:45215] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 02:11:15,908 DEBUG [RS:0;jenkins-hbase4:37335] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 02:11:15,908 DEBUG [RS:0;jenkins-hbase4:37335] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 02:11:15,909 DEBUG [RS:1;jenkins-hbase4:35673] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 02:11:15,909 DEBUG [RS:1;jenkins-hbase4:35673] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 02:11:15,912 DEBUG [RS:2;jenkins-hbase4:45215] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 02:11:15,913 DEBUG [RS:2;jenkins-hbase4:45215] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 02:11:15,914 DEBUG [RS:0;jenkins-hbase4:37335] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 02:11:15,922 DEBUG [RS:2;jenkins-hbase4:45215] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 02:11:15,924 DEBUG [RS:0;jenkins-hbase4:37335] zookeeper.ReadOnlyZKClient(139): Connect 0x749237b6 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:15,928 DEBUG [RS:2;jenkins-hbase4:45215] zookeeper.ReadOnlyZKClient(139): Connect 0x748530fb to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:15,928 DEBUG [RS:1;jenkins-hbase4:35673] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 02:11:15,947 DEBUG [RS:1;jenkins-hbase4:35673] zookeeper.ReadOnlyZKClient(139): Connect 0x014b5c25 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:15,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-17 02:11:15,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:15,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-17 02:11:16,006 DEBUG [RS:0;jenkins-hbase4:37335] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a55d754, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:16,008 DEBUG [RS:0;jenkins-hbase4:37335] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e6a5cc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 02:11:16,012 DEBUG [RS:2;jenkins-hbase4:45215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a42c01b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:16,012 DEBUG [RS:2;jenkins-hbase4:45215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e7d5b8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 02:11:16,015 DEBUG [RS:1;jenkins-hbase4:35673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f8ca27c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:16,016 DEBUG [RS:1;jenkins-hbase4:35673] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4eb1a847, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 02:11:16,047 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45215 2023-07-17 02:11:16,047 DEBUG [RS:0;jenkins-hbase4:37335] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37335 2023-07-17 02:11:16,048 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35673 2023-07-17 02:11:16,054 INFO [RS:2;jenkins-hbase4:45215] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 02:11:16,054 INFO [RS:0;jenkins-hbase4:37335] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 02:11:16,061 INFO [RS:0;jenkins-hbase4:37335] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 02:11:16,054 INFO [RS:1;jenkins-hbase4:35673] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 02:11:16,060 INFO [RS:2;jenkins-hbase4:45215] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 02:11:16,061 INFO [RS:1;jenkins-hbase4:35673] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 02:11:16,061 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 02:11:16,061 DEBUG [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 02:11:16,061 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 02:11:16,063 INFO [RS:0;jenkins-hbase4:37335] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:16,063 DEBUG [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 02:11:16,062 INFO [RS:2;jenkins-hbase4:45215] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:16,063 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 02:11:16,071 INFO [RS:1;jenkins-hbase4:35673] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:16,071 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 02:11:16,073 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40829,1689559872752 with isa=jenkins-hbase4.apache.org/172.31.14.131:35673, startcode=1689559874442 2023-07-17 02:11:16,073 INFO [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40829,1689559872752 with isa=jenkins-hbase4.apache.org/172.31.14.131:37335, startcode=1689559874362 2023-07-17 02:11:16,074 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40829,1689559872752 with isa=jenkins-hbase4.apache.org/172.31.14.131:45215, startcode=1689559874524 2023-07-17 02:11:16,100 DEBUG [RS:0;jenkins-hbase4:37335] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 02:11:16,100 DEBUG [RS:1;jenkins-hbase4:35673] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 02:11:16,100 DEBUG [RS:2;jenkins-hbase4:45215] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 02:11:16,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-17 02:11:16,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 02:11:16,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 02:11:16,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 02:11:16,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 02:11:16,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-17 02:11:16,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 02:11:16,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689559906184 2023-07-17 02:11:16,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-17 02:11:16,193 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 02:11:16,194 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-17 02:11:16,199 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 02:11:16,200 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37377, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 02:11:16,200 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49765, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 02:11:16,200 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40237, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 02:11:16,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-17 02:11:16,211 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40829] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 02:11:16,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-17 02:11:16,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-17 02:11:16,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-17 02:11:16,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-17 02:11:16,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,221 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40829] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 02:11:16,223 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40829] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 02:11:16,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-17 02:11:16,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-17 02:11:16,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-17 02:11:16,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-17 02:11:16,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-17 02:11:16,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689559876242,5,FailOnTimeoutGroup] 2023-07-17 02:11:16,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689559876246,5,FailOnTimeoutGroup] 2023-07-17 02:11:16,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-17 02:11:16,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,255 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 02:11:16,256 WARN [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 02:11:16,256 DEBUG [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 02:11:16,256 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 02:11:16,256 WARN [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 02:11:16,256 WARN [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 02:11:16,272 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 02:11:16,274 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 02:11:16,274 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:11:16,327 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:16,330 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 02:11:16,335 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/info 2023-07-17 02:11:16,336 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 02:11:16,337 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:16,337 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 02:11:16,341 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/rep_barrier 2023-07-17 02:11:16,342 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 02:11:16,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:16,343 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 02:11:16,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/table 2023-07-17 02:11:16,347 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 02:11:16,348 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:16,350 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740 2023-07-17 02:11:16,352 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740 2023-07-17 02:11:16,357 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40829,1689559872752 with isa=jenkins-hbase4.apache.org/172.31.14.131:45215, startcode=1689559874524 2023-07-17 02:11:16,357 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 02:11:16,357 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40829,1689559872752 with isa=jenkins-hbase4.apache.org/172.31.14.131:35673, startcode=1689559874442 2023-07-17 02:11:16,360 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 02:11:16,361 INFO [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40829,1689559872752 with isa=jenkins-hbase4.apache.org/172.31.14.131:37335, startcode=1689559874362 2023-07-17 02:11:16,379 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40829] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:16,380 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:11:16,384 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69185321, jitterRate=0.030941620469093323}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 02:11:16,384 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 02:11:16,385 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 02:11:16,385 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 02:11:16,385 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 02:11:16,385 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 02:11:16,385 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 02:11:16,387 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 02:11:16,387 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 02:11:16,388 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40829] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:16,389 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40829] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:16,391 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:11:16,391 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:11:16,391 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39797 2023-07-17 02:11:16,391 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 02:11:16,391 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39797 2023-07-17 02:11:16,392 DEBUG [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:11:16,392 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 02:11:16,392 DEBUG [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:39797 2023-07-17 02:11:16,392 DEBUG [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 02:11:16,395 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 02:11:16,395 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-17 02:11:16,399 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 02:11:16,409 DEBUG [RS:1;jenkins-hbase4:35673] zookeeper.ZKUtil(162): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:16,409 DEBUG [RS:2;jenkins-hbase4:45215] zookeeper.ZKUtil(162): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:16,409 WARN [RS:1;jenkins-hbase4:35673] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 02:11:16,415 INFO [RS:1;jenkins-hbase4:35673] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 02:11:16,415 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:16,415 DEBUG [RS:0;jenkins-hbase4:37335] zookeeper.ZKUtil(162): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:16,416 WARN [RS:0;jenkins-hbase4:37335] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 02:11:16,409 WARN [RS:2;jenkins-hbase4:45215] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 02:11:16,418 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37335,1689559874362] 2023-07-17 02:11:16,418 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45215,1689559874524] 2023-07-17 02:11:16,419 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35673,1689559874442] 2023-07-17 02:11:16,428 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-17 02:11:16,416 INFO [RS:0;jenkins-hbase4:37335] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 02:11:16,431 DEBUG [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:16,417 INFO [RS:2;jenkins-hbase4:45215] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 02:11:16,433 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1948): logDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:16,483 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-17 02:11:16,498 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-17 02:11:16,499 DEBUG [RS:0;jenkins-hbase4:37335] zookeeper.ZKUtil(162): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:16,501 DEBUG [RS:0;jenkins-hbase4:37335] zookeeper.ZKUtil(162): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:16,501 DEBUG [RS:0;jenkins-hbase4:37335] zookeeper.ZKUtil(162): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:16,502 DEBUG [RS:2;jenkins-hbase4:45215] zookeeper.ZKUtil(162): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:16,503 DEBUG [RS:1;jenkins-hbase4:35673] zookeeper.ZKUtil(162): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:16,503 DEBUG [RS:2;jenkins-hbase4:45215] zookeeper.ZKUtil(162): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:16,503 DEBUG [RS:1;jenkins-hbase4:35673] zookeeper.ZKUtil(162): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:16,504 DEBUG [RS:2;jenkins-hbase4:45215] zookeeper.ZKUtil(162): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:16,504 DEBUG [RS:1;jenkins-hbase4:35673] zookeeper.ZKUtil(162): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:16,519 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 02:11:16,519 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 02:11:16,519 DEBUG [RS:0;jenkins-hbase4:37335] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 02:11:16,531 INFO [RS:2;jenkins-hbase4:45215] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 02:11:16,532 INFO [RS:1;jenkins-hbase4:35673] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 02:11:16,531 INFO [RS:0;jenkins-hbase4:37335] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 02:11:16,562 INFO [RS:0;jenkins-hbase4:37335] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 02:11:16,562 INFO [RS:2;jenkins-hbase4:45215] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 02:11:16,562 INFO [RS:1;jenkins-hbase4:35673] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 02:11:16,567 INFO [RS:1;jenkins-hbase4:35673] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 02:11:16,567 INFO [RS:2;jenkins-hbase4:45215] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 02:11:16,567 INFO [RS:0;jenkins-hbase4:37335] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 02:11:16,568 INFO [RS:2;jenkins-hbase4:45215] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,568 INFO [RS:1;jenkins-hbase4:35673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,568 INFO [RS:0;jenkins-hbase4:37335] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,571 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 02:11:16,571 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 02:11:16,571 INFO [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 02:11:16,581 INFO [RS:0;jenkins-hbase4:37335] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,581 INFO [RS:1;jenkins-hbase4:35673] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,581 INFO [RS:2;jenkins-hbase4:45215] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,581 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,582 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,582 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,582 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,582 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,582 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,582 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,582 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,582 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,582 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 02:11:16,583 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 02:11:16,583 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:1;jenkins-hbase4:35673] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,584 DEBUG [RS:2;jenkins-hbase4:45215] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,583 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 02:11:16,584 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,585 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,585 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,585 DEBUG [RS:0;jenkins-hbase4:37335] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 02:11:16,587 INFO [RS:1;jenkins-hbase4:35673] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,587 INFO [RS:2;jenkins-hbase4:45215] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,587 INFO [RS:1;jenkins-hbase4:35673] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,587 INFO [RS:0;jenkins-hbase4:37335] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,587 INFO [RS:2;jenkins-hbase4:45215] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,587 INFO [RS:0;jenkins-hbase4:37335] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,587 INFO [RS:1;jenkins-hbase4:35673] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,587 INFO [RS:0;jenkins-hbase4:37335] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,587 INFO [RS:2;jenkins-hbase4:45215] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,607 INFO [RS:2;jenkins-hbase4:45215] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 02:11:16,607 INFO [RS:1;jenkins-hbase4:35673] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 02:11:16,607 INFO [RS:0;jenkins-hbase4:37335] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 02:11:16,611 INFO [RS:2;jenkins-hbase4:45215] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45215,1689559874524-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,611 INFO [RS:1;jenkins-hbase4:35673] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35673,1689559874442-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,611 INFO [RS:0;jenkins-hbase4:37335] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37335,1689559874362-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:16,642 INFO [RS:1;jenkins-hbase4:35673] regionserver.Replication(203): jenkins-hbase4.apache.org,35673,1689559874442 started 2023-07-17 02:11:16,643 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35673,1689559874442, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35673, sessionid=0x101710c34000002 2023-07-17 02:11:16,651 DEBUG [jenkins-hbase4:40829] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-17 02:11:16,656 INFO [RS:0;jenkins-hbase4:37335] regionserver.Replication(203): jenkins-hbase4.apache.org,37335,1689559874362 started 2023-07-17 02:11:16,656 INFO [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37335,1689559874362, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37335, sessionid=0x101710c34000001 2023-07-17 02:11:16,657 DEBUG [jenkins-hbase4:40829] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:11:16,661 INFO [RS:2;jenkins-hbase4:45215] regionserver.Replication(203): jenkins-hbase4.apache.org,45215,1689559874524 started 2023-07-17 02:11:16,661 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45215,1689559874524, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45215, sessionid=0x101710c34000003 2023-07-17 02:11:16,661 DEBUG [RS:2;jenkins-hbase4:45215] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 02:11:16,661 DEBUG [RS:2;jenkins-hbase4:45215] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:16,661 DEBUG [RS:2;jenkins-hbase4:45215] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45215,1689559874524' 2023-07-17 02:11:16,661 DEBUG [RS:2;jenkins-hbase4:45215] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 02:11:16,661 DEBUG [RS:0;jenkins-hbase4:37335] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 02:11:16,661 DEBUG [RS:1;jenkins-hbase4:35673] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 02:11:16,662 DEBUG [RS:1;jenkins-hbase4:35673] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:16,662 DEBUG [RS:0;jenkins-hbase4:37335] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:16,664 DEBUG [RS:2;jenkins-hbase4:45215] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 02:11:16,663 DEBUG [RS:1;jenkins-hbase4:35673] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35673,1689559874442' 2023-07-17 02:11:16,664 DEBUG [RS:1;jenkins-hbase4:35673] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 02:11:16,664 DEBUG [RS:0;jenkins-hbase4:37335] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37335,1689559874362' 2023-07-17 02:11:16,665 DEBUG [RS:0;jenkins-hbase4:37335] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 02:11:16,665 DEBUG [RS:2;jenkins-hbase4:45215] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 02:11:16,665 DEBUG [RS:1;jenkins-hbase4:35673] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 02:11:16,666 DEBUG [RS:1;jenkins-hbase4:35673] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 02:11:16,666 DEBUG [RS:1;jenkins-hbase4:35673] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 02:11:16,666 DEBUG [RS:0;jenkins-hbase4:37335] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 02:11:16,667 DEBUG [RS:0;jenkins-hbase4:37335] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 02:11:16,667 DEBUG [RS:0;jenkins-hbase4:37335] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 02:11:16,665 DEBUG [RS:2;jenkins-hbase4:45215] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 02:11:16,666 DEBUG [RS:1;jenkins-hbase4:35673] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:16,667 DEBUG [RS:1;jenkins-hbase4:35673] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35673,1689559874442' 2023-07-17 02:11:16,667 DEBUG [RS:1;jenkins-hbase4:35673] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:16,668 DEBUG [RS:1;jenkins-hbase4:35673] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:16,669 DEBUG [RS:1;jenkins-hbase4:35673] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 02:11:16,669 DEBUG [jenkins-hbase4:40829] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:11:16,667 DEBUG [RS:2;jenkins-hbase4:45215] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:16,667 DEBUG [RS:0;jenkins-hbase4:37335] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:16,670 DEBUG [RS:2;jenkins-hbase4:45215] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45215,1689559874524' 2023-07-17 02:11:16,670 DEBUG [RS:2;jenkins-hbase4:45215] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:16,670 DEBUG [jenkins-hbase4:40829] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:11:16,670 DEBUG [jenkins-hbase4:40829] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:11:16,670 DEBUG [jenkins-hbase4:40829] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:11:16,670 DEBUG [RS:2;jenkins-hbase4:45215] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:16,669 INFO [RS:1;jenkins-hbase4:35673] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 02:11:16,670 DEBUG [RS:0;jenkins-hbase4:37335] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37335,1689559874362' 2023-07-17 02:11:16,671 DEBUG [RS:0;jenkins-hbase4:37335] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:16,671 INFO [RS:1;jenkins-hbase4:35673] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 02:11:16,671 DEBUG [RS:2;jenkins-hbase4:45215] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 02:11:16,671 INFO [RS:2;jenkins-hbase4:45215] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 02:11:16,672 INFO [RS:2;jenkins-hbase4:45215] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 02:11:16,675 DEBUG [RS:0;jenkins-hbase4:37335] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:16,676 DEBUG [RS:0;jenkins-hbase4:37335] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 02:11:16,676 INFO [RS:0;jenkins-hbase4:37335] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 02:11:16,676 INFO [RS:0;jenkins-hbase4:37335] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 02:11:16,677 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35673,1689559874442, state=OPENING 2023-07-17 02:11:16,688 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-17 02:11:16,689 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:11:16,690 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 02:11:16,695 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:11:16,784 INFO [RS:0;jenkins-hbase4:37335] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37335%2C1689559874362, suffix=, logDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,37335,1689559874362, archiveDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/oldWALs, maxLogs=32 2023-07-17 02:11:16,787 INFO [RS:2;jenkins-hbase4:45215] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45215%2C1689559874524, suffix=, logDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,45215,1689559874524, archiveDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/oldWALs, maxLogs=32 2023-07-17 02:11:16,794 INFO [RS:1;jenkins-hbase4:35673] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35673%2C1689559874442, suffix=, logDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,35673,1689559874442, archiveDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/oldWALs, maxLogs=32 2023-07-17 02:11:16,857 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK] 2023-07-17 02:11:16,857 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK] 2023-07-17 02:11:16,857 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK] 2023-07-17 02:11:16,861 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK] 2023-07-17 02:11:16,866 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK] 2023-07-17 02:11:16,866 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK] 2023-07-17 02:11:16,868 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK] 2023-07-17 02:11:16,868 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK] 2023-07-17 02:11:16,871 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK] 2023-07-17 02:11:16,886 INFO [RS:0;jenkins-hbase4:37335] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,37335,1689559874362/jenkins-hbase4.apache.org%2C37335%2C1689559874362.1689559876786 2023-07-17 02:11:16,886 DEBUG [RS:0;jenkins-hbase4:37335] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK], DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK], DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK]] 2023-07-17 02:11:16,891 INFO [RS:2;jenkins-hbase4:45215] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,45215,1689559874524/jenkins-hbase4.apache.org%2C45215%2C1689559874524.1689559876789 2023-07-17 02:11:16,892 DEBUG [RS:2;jenkins-hbase4:45215] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK], DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK], DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK]] 2023-07-17 02:11:16,919 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:16,922 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 02:11:16,923 INFO [RS:1;jenkins-hbase4:35673] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,35673,1689559874442/jenkins-hbase4.apache.org%2C35673%2C1689559874442.1689559876796 2023-07-17 02:11:16,923 DEBUG [RS:1;jenkins-hbase4:35673] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK], DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK], DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK]] 2023-07-17 02:11:16,930 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 02:11:16,948 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-17 02:11:16,949 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 02:11:16,955 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35673%2C1689559874442.meta, suffix=.meta, logDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,35673,1689559874442, archiveDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/oldWALs, maxLogs=32 2023-07-17 02:11:16,983 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK] 2023-07-17 02:11:16,984 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK] 2023-07-17 02:11:16,984 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK] 2023-07-17 02:11:17,001 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/WALs/jenkins-hbase4.apache.org,35673,1689559874442/jenkins-hbase4.apache.org%2C35673%2C1689559874442.meta.1689559876957.meta 2023-07-17 02:11:17,002 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36471,DS-7b6f4735-a654-4f78-9066-a61d339b75e8,DISK], DatanodeInfoWithStorage[127.0.0.1:38869,DS-107943c4-e77e-4ed4-909a-a14e55962174,DISK], DatanodeInfoWithStorage[127.0.0.1:37873,DS-f2218451-dd72-4ad6-b1bf-88f96991c0f3,DISK]] 2023-07-17 02:11:17,003 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-17 02:11:17,004 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-17 02:11:17,005 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:17,006 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-17 02:11:17,008 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-17 02:11:17,010 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-17 02:11:17,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-17 02:11:17,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:17,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-17 02:11:17,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-17 02:11:17,042 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 02:11:17,045 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/info 2023-07-17 02:11:17,045 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/info 2023-07-17 02:11:17,046 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 02:11:17,047 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:17,047 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 02:11:17,049 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/rep_barrier 2023-07-17 02:11:17,049 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/rep_barrier 2023-07-17 02:11:17,050 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 02:11:17,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:17,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 02:11:17,053 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/table 2023-07-17 02:11:17,053 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/table 2023-07-17 02:11:17,053 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 02:11:17,054 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:17,056 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740 2023-07-17 02:11:17,059 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740 2023-07-17 02:11:17,067 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 02:11:17,083 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 02:11:17,086 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67927396, jitterRate=0.01219707727432251}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 02:11:17,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 02:11:17,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689559876903 2023-07-17 02:11:17,127 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-17 02:11:17,129 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-17 02:11:17,129 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35673,1689559874442, state=OPEN 2023-07-17 02:11:17,132 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-17 02:11:17,132 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 02:11:17,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-17 02:11:17,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35673,1689559874442 in 437 msec 2023-07-17 02:11:17,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-17 02:11:17,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 713 msec 2023-07-17 02:11:17,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1950 sec 2023-07-17 02:11:17,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689559877174, completionTime=-1 2023-07-17 02:11:17,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-17 02:11:17,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-17 02:11:17,262 DEBUG [hconnection-0x798c2dbc-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:17,268 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:17,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-17 02:11:17,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689559937296 2023-07-17 02:11:17,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689559997296 2023-07-17 02:11:17,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 121 msec 2023-07-17 02:11:17,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40829,1689559872752-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:17,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40829,1689559872752-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:17,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40829,1689559872752-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:17,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40829, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:17,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-17 02:11:17,339 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-17 02:11:17,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-17 02:11:17,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 02:11:17,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-17 02:11:17,365 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 02:11:17,369 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 02:11:17,396 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:11:17,399 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc empty. 2023-07-17 02:11:17,400 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:11:17,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-17 02:11:17,458 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-17 02:11:17,463 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e06d40081fa369e1ba41c9bcb4aeabdc, NAME => 'hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:11:17,494 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:17,494 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e06d40081fa369e1ba41c9bcb4aeabdc, disabling compactions & flushes 2023-07-17 02:11:17,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:11:17,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:11:17,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. after waiting 0 ms 2023-07-17 02:11:17,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:11:17,495 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:11:17,495 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e06d40081fa369e1ba41c9bcb4aeabdc: 2023-07-17 02:11:17,500 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 02:11:17,516 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689559877503"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559877503"}]},"ts":"1689559877503"} 2023-07-17 02:11:17,550 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 02:11:17,552 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 02:11:17,561 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559877553"}]},"ts":"1689559877553"} 2023-07-17 02:11:17,566 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-17 02:11:17,570 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:11:17,571 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:11:17,571 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:11:17,571 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:11:17,572 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:11:17,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e06d40081fa369e1ba41c9bcb4aeabdc, ASSIGN}] 2023-07-17 02:11:17,579 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e06d40081fa369e1ba41c9bcb4aeabdc, ASSIGN 2023-07-17 02:11:17,581 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e06d40081fa369e1ba41c9bcb4aeabdc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45215,1689559874524; forceNewPlan=false, retain=false 2023-07-17 02:11:17,733 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 02:11:17,734 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e06d40081fa369e1ba41c9bcb4aeabdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:17,734 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689559877734"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559877734"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559877734"}]},"ts":"1689559877734"} 2023-07-17 02:11:17,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e06d40081fa369e1ba41c9bcb4aeabdc, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:11:17,894 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:17,894 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 02:11:17,898 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 02:11:17,906 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:11:17,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e06d40081fa369e1ba41c9bcb4aeabdc, NAME => 'hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc.', STARTKEY => '', ENDKEY => ''} 2023-07-17 02:11:17,907 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. service=AccessControlService 2023-07-17 02:11:17,907 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:17,908 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:11:17,908 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:17,908 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:11:17,908 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:11:17,911 INFO [StoreOpener-e06d40081fa369e1ba41c9bcb4aeabdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:11:17,913 DEBUG [StoreOpener-e06d40081fa369e1ba41c9bcb4aeabdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc/info 2023-07-17 02:11:17,913 DEBUG [StoreOpener-e06d40081fa369e1ba41c9bcb4aeabdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc/info 2023-07-17 02:11:17,914 INFO [StoreOpener-e06d40081fa369e1ba41c9bcb4aeabdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e06d40081fa369e1ba41c9bcb4aeabdc columnFamilyName info 2023-07-17 02:11:17,915 INFO [StoreOpener-e06d40081fa369e1ba41c9bcb4aeabdc-1] regionserver.HStore(310): Store=e06d40081fa369e1ba41c9bcb4aeabdc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:17,917 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:11:17,919 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:11:17,924 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:11:17,929 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:11:17,930 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e06d40081fa369e1ba41c9bcb4aeabdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61694507, jitterRate=-0.08068020641803741}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:11:17,930 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e06d40081fa369e1ba41c9bcb4aeabdc: 2023-07-17 02:11:17,937 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc., pid=6, masterSystemTime=1689559877894 2023-07-17 02:11:17,943 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:11:17,943 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:11:17,945 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e06d40081fa369e1ba41c9bcb4aeabdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:17,945 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689559877944"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559877944"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559877944"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559877944"}]},"ts":"1689559877944"} 2023-07-17 02:11:17,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-17 02:11:17,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e06d40081fa369e1ba41c9bcb4aeabdc, server=jenkins-hbase4.apache.org,45215,1689559874524 in 211 msec 2023-07-17 02:11:17,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-17 02:11:17,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e06d40081fa369e1ba41c9bcb4aeabdc, ASSIGN in 381 msec 2023-07-17 02:11:17,961 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 02:11:17,961 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559877961"}]},"ts":"1689559877961"} 2023-07-17 02:11:17,966 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-17 02:11:17,969 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 02:11:17,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-17 02:11:17,972 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-17 02:11:17,972 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:11:17,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 620 msec 2023-07-17 02:11:17,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:17,997 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:18,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-17 02:11:18,029 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 02:11:18,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-07-17 02:11:18,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-17 02:11:18,072 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 02:11:18,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 33 msec 2023-07-17 02:11:18,092 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-17 02:11:18,096 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-17 02:11:18,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.475sec 2023-07-17 02:11:18,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-17 02:11:18,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-17 02:11:18,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-17 02:11:18,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40829,1689559872752-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-17 02:11:18,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40829,1689559872752-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-17 02:11:18,110 DEBUG [Listener at localhost/37735] zookeeper.ReadOnlyZKClient(139): Connect 0x3abf2aba to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:18,130 DEBUG [Listener at localhost/37735] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bdfb8b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:18,141 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 02:11:18,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-17 02:11:18,146 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 02:11:18,149 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 02:11:18,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-17 02:11:18,155 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:11:18,156 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00 empty. 2023-07-17 02:11:18,156 DEBUG [hconnection-0x3923f56d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:18,159 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:11:18,159 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-17 02:11:18,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 02:11:18,176 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:18,179 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:11:18,179 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-17 02:11:18,179 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/test.cache.data in system properties and HBase conf 2023-07-17 02:11:18,179 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 02:11:18,179 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop.log.dir in system properties and HBase conf 2023-07-17 02:11:18,179 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 02:11:18,179 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 02:11:18,179 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 02:11:18,180 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 02:11:18,180 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 02:11:18,180 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 02:11:18,180 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 02:11:18,180 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 02:11:18,180 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 02:11:18,180 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 02:11:18,180 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 02:11:18,181 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 02:11:18,181 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/nfs.dump.dir in system properties and HBase conf 2023-07-17 02:11:18,181 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir in system properties and HBase conf 2023-07-17 02:11:18,181 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 02:11:18,181 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 02:11:18,181 INFO [Listener at localhost/37735] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-17 02:11:18,232 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-17 02:11:18,235 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 935ff182eebb818a965f31c5ec08cc00, NAME => 'hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:11:18,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 02:11:18,299 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:18,299 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 935ff182eebb818a965f31c5ec08cc00, disabling compactions & flushes 2023-07-17 02:11:18,300 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:11:18,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:11:18,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. after waiting 0 ms 2023-07-17 02:11:18,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:11:18,300 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:11:18,300 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 935ff182eebb818a965f31c5ec08cc00: 2023-07-17 02:11:18,309 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 02:11:18,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689559878311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559878311"}]},"ts":"1689559878311"} 2023-07-17 02:11:18,317 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 02:11:18,321 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 02:11:18,321 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559878321"}]},"ts":"1689559878321"} 2023-07-17 02:11:18,324 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-17 02:11:18,332 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:11:18,337 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:11:18,338 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:11:18,338 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:11:18,338 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:11:18,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=935ff182eebb818a965f31c5ec08cc00, ASSIGN}] 2023-07-17 02:11:18,347 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=935ff182eebb818a965f31c5ec08cc00, ASSIGN 2023-07-17 02:11:18,349 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=935ff182eebb818a965f31c5ec08cc00, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45215,1689559874524; forceNewPlan=false, retain=false 2023-07-17 02:11:18,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 02:11:18,499 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 02:11:18,501 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=935ff182eebb818a965f31c5ec08cc00, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:18,501 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689559878501"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559878501"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559878501"}]},"ts":"1689559878501"} 2023-07-17 02:11:18,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 935ff182eebb818a965f31c5ec08cc00, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:11:18,672 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:11:18,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 935ff182eebb818a965f31c5ec08cc00, NAME => 'hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00.', STARTKEY => '', ENDKEY => ''} 2023-07-17 02:11:18,672 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. service=AccessControlService 2023-07-17 02:11:18,673 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:18,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:11:18,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:18,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:11:18,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:11:18,683 INFO [StoreOpener-935ff182eebb818a965f31c5ec08cc00-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:11:18,687 DEBUG [StoreOpener-935ff182eebb818a965f31c5ec08cc00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00/l 2023-07-17 02:11:18,687 DEBUG [StoreOpener-935ff182eebb818a965f31c5ec08cc00-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00/l 2023-07-17 02:11:18,688 INFO [StoreOpener-935ff182eebb818a965f31c5ec08cc00-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 935ff182eebb818a965f31c5ec08cc00 columnFamilyName l 2023-07-17 02:11:18,689 INFO [StoreOpener-935ff182eebb818a965f31c5ec08cc00-1] regionserver.HStore(310): Store=935ff182eebb818a965f31c5ec08cc00/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:18,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:11:18,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:11:18,700 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:11:18,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:11:18,715 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 935ff182eebb818a965f31c5ec08cc00; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69155314, jitterRate=0.030494481325149536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:11:18,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 935ff182eebb818a965f31c5ec08cc00: 2023-07-17 02:11:18,718 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00., pid=11, masterSystemTime=1689559878662 2023-07-17 02:11:18,721 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:11:18,721 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:11:18,723 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=935ff182eebb818a965f31c5ec08cc00, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:18,723 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689559878723"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559878723"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559878723"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559878723"}]},"ts":"1689559878723"} 2023-07-17 02:11:18,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-17 02:11:18,735 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 935ff182eebb818a965f31c5ec08cc00, server=jenkins-hbase4.apache.org,45215,1689559874524 in 221 msec 2023-07-17 02:11:18,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-17 02:11:18,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=935ff182eebb818a965f31c5ec08cc00, ASSIGN in 397 msec 2023-07-17 02:11:18,746 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 02:11:18,746 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559878746"}]},"ts":"1689559878746"} 2023-07-17 02:11:18,749 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-17 02:11:18,753 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 02:11:18,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 612 msec 2023-07-17 02:11:18,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 02:11:18,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-17 02:11:18,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-17 02:11:19,721 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 02:11:20,113 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 02:11:20,123 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37777_jobhistory____ay1fmk/webapp 2023-07-17 02:11:20,311 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-17 02:11:20,311 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-17 02:11:20,311 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 02:11:20,316 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 02:11:20,406 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:20,740 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:21,216 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-17 02:11:21,292 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37777 2023-07-17 02:11:22,599 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 02:11:22,906 WARN [Listener at jenkins-hbase4.apache.org/34091] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 02:11:22,961 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-17 02:11:22,963 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-17 02:11:22,965 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-17 02:11:22,966 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:11:22,967 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-17 02:11:22,967 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:11:22,967 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-17 02:11:22,968 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 02:11:22,968 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-17 02:11:22,971 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:11:22,971 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-17 02:11:22,971 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 02:11:22,971 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-17 02:11:23,020 WARN [Listener at jenkins-hbase4.apache.org/34091] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 02:11:23,021 INFO [Listener at jenkins-hbase4.apache.org/34091] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 02:11:23,040 INFO [Listener at jenkins-hbase4.apache.org/34091] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35999_cluster____8nirx/webapp 2023-07-17 02:11:23,115 INFO [Listener at jenkins-hbase4.apache.org/34091] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 02:11:23,115 INFO [Listener at jenkins-hbase4.apache.org/34091] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-17 02:11:23,115 INFO [Listener at jenkins-hbase4.apache.org/34091] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 02:11:23,116 INFO [Listener at jenkins-hbase4.apache.org/34091] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 02:11:23,125 INFO [Listener at jenkins-hbase4.apache.org/34091] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:23,337 INFO [Listener at jenkins-hbase4.apache.org/34091] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:23,475 INFO [Listener at jenkins-hbase4.apache.org/34091] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:23,490 INFO [Listener at jenkins-hbase4.apache.org/34091] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35999 2023-07-17 02:11:24,050 WARN [Listener at jenkins-hbase4.apache.org/32925] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 02:11:24,077 WARN [Listener at jenkins-hbase4.apache.org/32925] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 02:11:24,078 INFO [Listener at jenkins-hbase4.apache.org/32925] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 02:11:24,087 INFO [Listener at jenkins-hbase4.apache.org/32925] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40289_node____.nhsh6z/webapp 2023-07-17 02:11:24,142 INFO [Listener at jenkins-hbase4.apache.org/32925] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 02:11:24,143 INFO [Listener at jenkins-hbase4.apache.org/32925] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 02:11:24,143 INFO [Listener at jenkins-hbase4.apache.org/32925] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 02:11:24,143 INFO [Listener at jenkins-hbase4.apache.org/32925] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 02:11:24,156 INFO [Listener at jenkins-hbase4.apache.org/32925] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:24,198 INFO [Listener at jenkins-hbase4.apache.org/32925] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:24,319 INFO [Listener at jenkins-hbase4.apache.org/32925] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:24,334 INFO [Listener at jenkins-hbase4.apache.org/32925] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40289 2023-07-17 02:11:24,640 WARN [Listener at jenkins-hbase4.apache.org/46125] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 02:11:24,646 WARN [Listener at jenkins-hbase4.apache.org/46125] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 02:11:24,647 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 02:11:24,656 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34871_node____.h22enl/webapp 2023-07-17 02:11:24,713 INFO [Listener at jenkins-hbase4.apache.org/46125] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 02:11:24,713 INFO [Listener at jenkins-hbase4.apache.org/46125] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 02:11:24,713 INFO [Listener at jenkins-hbase4.apache.org/46125] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 02:11:24,714 INFO [Listener at jenkins-hbase4.apache.org/46125] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 02:11:24,725 INFO [Listener at jenkins-hbase4.apache.org/46125] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:24,748 INFO [Listener at jenkins-hbase4.apache.org/46125] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:24,844 INFO [Listener at jenkins-hbase4.apache.org/46125] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 02:11:24,851 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34871 2023-07-17 02:11:24,885 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-17 02:11:24,887 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:11:24,955 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=911, MaxFileDescriptor=60000, SystemLoadAverage=384, ProcessCount=173, AvailableMemoryMB=4652 2023-07-17 02:11:24,955 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-17 02:11:24,970 DEBUG [Listener at jenkins-hbase4.apache.org/46125] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-17 02:11:24,977 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-17 02:11:24,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 02:11:24,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-17 02:11:24,992 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 02:11:24,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-17 02:11:24,995 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 02:11:24,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 02:11:25,003 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:25,003 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:25,005 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388 empty. 2023-07-17 02:11:25,005 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8 empty. 2023-07-17 02:11:25,008 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:25,010 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:25,011 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 02:11:25,059 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-17 02:11:25,061 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => e47fb4c61d46391733f9f51943fe68c8, NAME => 'testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:11:25,061 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => a44d38fa73ed7d9f2ace32b22aea5388, NAME => 'testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:11:25,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 02:11:25,105 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:25,108 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing a44d38fa73ed7d9f2ace32b22aea5388, disabling compactions & flushes 2023-07-17 02:11:25,109 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. after waiting 0 ms 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:25,109 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for a44d38fa73ed7d9f2ace32b22aea5388: 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing e47fb4c61d46391733f9f51943fe68c8, disabling compactions & flushes 2023-07-17 02:11:25,109 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. after waiting 0 ms 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:25,109 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:25,109 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for e47fb4c61d46391733f9f51943fe68c8: 2023-07-17 02:11:25,113 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 02:11:25,115 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559885114"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559885114"}]},"ts":"1689559885114"} 2023-07-17 02:11:25,115 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559885114"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559885114"}]},"ts":"1689559885114"} 2023-07-17 02:11:25,167 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 02:11:25,169 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 02:11:25,169 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559885169"}]},"ts":"1689559885169"} 2023-07-17 02:11:25,171 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-17 02:11:25,176 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:11:25,178 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:11:25,178 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:11:25,178 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:11:25,178 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:11:25,178 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e47fb4c61d46391733f9f51943fe68c8, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a44d38fa73ed7d9f2ace32b22aea5388, ASSIGN}] 2023-07-17 02:11:25,181 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a44d38fa73ed7d9f2ace32b22aea5388, ASSIGN 2023-07-17 02:11:25,181 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e47fb4c61d46391733f9f51943fe68c8, ASSIGN 2023-07-17 02:11:25,182 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a44d38fa73ed7d9f2ace32b22aea5388, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35673,1689559874442; forceNewPlan=false, retain=false 2023-07-17 02:11:25,182 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e47fb4c61d46391733f9f51943fe68c8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37335,1689559874362; forceNewPlan=false, retain=false 2023-07-17 02:11:25,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 02:11:25,332 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 02:11:25,335 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a44d38fa73ed7d9f2ace32b22aea5388, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:25,335 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e47fb4c61d46391733f9f51943fe68c8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:25,335 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559885335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559885335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559885335"}]},"ts":"1689559885335"} 2023-07-17 02:11:25,335 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559885335"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559885335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559885335"}]},"ts":"1689559885335"} 2023-07-17 02:11:25,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure a44d38fa73ed7d9f2ace32b22aea5388, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:11:25,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure e47fb4c61d46391733f9f51943fe68c8, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:11:25,497 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:25,497 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 02:11:25,503 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 02:11:25,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:25,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a44d38fa73ed7d9f2ace32b22aea5388, NAME => 'testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 02:11:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. service=AccessControlService 2023-07-17 02:11:25,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:25,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:25,512 INFO [StoreOpener-a44d38fa73ed7d9f2ace32b22aea5388-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:25,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:25,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e47fb4c61d46391733f9f51943fe68c8, NAME => 'testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 02:11:25,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. service=AccessControlService 2023-07-17 02:11:25,521 DEBUG [StoreOpener-a44d38fa73ed7d9f2ace32b22aea5388-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/cf 2023-07-17 02:11:25,521 DEBUG [StoreOpener-a44d38fa73ed7d9f2ace32b22aea5388-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/cf 2023-07-17 02:11:25,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:25,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:25,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:25,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:25,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:25,522 INFO [StoreOpener-a44d38fa73ed7d9f2ace32b22aea5388-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a44d38fa73ed7d9f2ace32b22aea5388 columnFamilyName cf 2023-07-17 02:11:25,522 INFO [StoreOpener-a44d38fa73ed7d9f2ace32b22aea5388-1] regionserver.HStore(310): Store=a44d38fa73ed7d9f2ace32b22aea5388/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:25,523 INFO [StoreOpener-e47fb4c61d46391733f9f51943fe68c8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:25,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:25,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:25,527 DEBUG [StoreOpener-e47fb4c61d46391733f9f51943fe68c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/cf 2023-07-17 02:11:25,527 DEBUG [StoreOpener-e47fb4c61d46391733f9f51943fe68c8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/cf 2023-07-17 02:11:25,527 INFO [StoreOpener-e47fb4c61d46391733f9f51943fe68c8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e47fb4c61d46391733f9f51943fe68c8 columnFamilyName cf 2023-07-17 02:11:25,528 INFO [StoreOpener-e47fb4c61d46391733f9f51943fe68c8-1] regionserver.HStore(310): Store=e47fb4c61d46391733f9f51943fe68c8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:25,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:25,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:25,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:25,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:25,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:11:25,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a44d38fa73ed7d9f2ace32b22aea5388; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58995876, jitterRate=-0.12089294195175171}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:11:25,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a44d38fa73ed7d9f2ace32b22aea5388: 2023-07-17 02:11:25,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388., pid=15, masterSystemTime=1689559885491 2023-07-17 02:11:25,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:11:25,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e47fb4c61d46391733f9f51943fe68c8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71727198, jitterRate=0.06881853938102722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:11:25,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e47fb4c61d46391733f9f51943fe68c8: 2023-07-17 02:11:25,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8., pid=16, masterSystemTime=1689559885497 2023-07-17 02:11:25,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:25,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:25,559 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a44d38fa73ed7d9f2ace32b22aea5388, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:25,559 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559885559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559885559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559885559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559885559"}]},"ts":"1689559885559"} 2023-07-17 02:11:25,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:25,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:25,561 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=e47fb4c61d46391733f9f51943fe68c8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:25,562 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559885561"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559885561"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559885561"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559885561"}]},"ts":"1689559885561"} 2023-07-17 02:11:25,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-17 02:11:25,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure a44d38fa73ed7d9f2ace32b22aea5388, server=jenkins-hbase4.apache.org,35673,1689559874442 in 226 msec 2023-07-17 02:11:25,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-17 02:11:25,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a44d38fa73ed7d9f2ace32b22aea5388, ASSIGN in 389 msec 2023-07-17 02:11:25,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure e47fb4c61d46391733f9f51943fe68c8, server=jenkins-hbase4.apache.org,37335,1689559874362 in 225 msec 2023-07-17 02:11:25,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-17 02:11:25,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e47fb4c61d46391733f9f51943fe68c8, ASSIGN in 392 msec 2023-07-17 02:11:25,574 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 02:11:25,574 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559885574"}]},"ts":"1689559885574"} 2023-07-17 02:11:25,576 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-17 02:11:25,579 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 02:11:25,585 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-17 02:11:25,595 DEBUG [hconnection-0x337c04ea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:25,598 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-17 02:11:25,610 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 02:11:25,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 02:11:25,650 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:25,650 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:25,650 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:25,650 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:25,650 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:11:25,658 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 02:11:25,658 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 02:11:25,658 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 02:11:25,658 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 02:11:25,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 671 msec 2023-07-17 02:11:26,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 02:11:26,118 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-17 02:11:26,119 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-17 02:11:26,120 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:11:26,126 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-17 02:11:26,127 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:11:26,127 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-17 02:11:26,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 02:11:26,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559886143 (current time:1689559886143). 2023-07-17 02:11:26,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:11:26,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x3aa83a3f to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:26,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f5239, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:26,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:26,156 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:26,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aa83a3f to 127.0.0.1:62514 2023-07-17 02:11:26,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:11:26,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x50bd3fdb to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:26,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59bd1af2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:26,171 DEBUG [hconnection-0x55a582b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:26,172 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:26,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:26,178 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:26,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50bd3fdb to 127.0.0.1:62514 2023-07-17 02:11:26,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:11:26,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 02:11:26,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:11:26,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 02:11:26,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 02:11:26,225 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 02:11:26,226 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689560486226 2023-07-17 02:11:26,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 02:11:26,227 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 02:11:26,230 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 02:11:26,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 02:11:26,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-07-17 02:11:26,233 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 02:11:26,234 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:11:26,234 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:11:26,235 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689560486235 2023-07-17 02:11:26,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,258 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-17 02:11:26,258 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:26,260 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 02:11:26,260 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 02:11:26,261 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,261 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,267 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:26,267 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:26,268 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:26,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:26,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:26,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:26,268 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:26,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:26,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:26,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,269 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,269 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,270 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,270 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:11:26,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 02:11:26,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 02:11:26,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 02:11:26,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 02:11:26,271 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 02:11:26,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,272 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 02:11:26,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,280 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 02:11:26,280 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:26,280 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 02:11:26,281 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 02:11:26,280 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 02:11:26,281 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 02:11:26,282 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:26,282 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 02:11:26,281 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:26,283 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 02:11:26,284 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 02:11:26,284 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 02:11:26,284 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 02:11:26,284 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 02:11:26,284 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 02:11:26,286 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,286 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,287 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,287 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,287 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,287 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:26,287 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,287 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,287 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:26,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:26,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:26,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 02:11:26,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a2386f2[Count = 1] remaining members to acquire global barrier 2023-07-17 02:11:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:26,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:26,291 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:26,291 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:26,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:26,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:26,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 02:11:26,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a2386f2[Count = 0] remaining members to acquire global barrier 2023-07-17 02:11:26,296 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 02:11:26,296 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 02:11:26,299 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,299 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 02:11:26,299 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 02:11:26,299 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 02:11:26,300 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:11:26,300 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,300 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:11:26,301 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:11:26,301 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:11:26,301 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:26,301 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:26,301 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:11:26,301 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:11:26,301 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. started... 2023-07-17 02:11:26,301 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. started... 2023-07-17 02:11:26,304 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 02:11:26,305 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:26,305 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 02:11:26,307 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a44d38fa73ed7d9f2ace32b22aea5388: 2023-07-17 02:11:26,307 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e47fb4c61d46391733f9f51943fe68c8: 2023-07-17 02:11:26,308 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,308 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,313 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:11:26,313 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:11:26,317 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:11:26,317 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:11:26,335 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:26,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 02:11:26,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:11:26,341 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:11:26,541 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:26,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 02:11:26,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:11:26,543 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 02:11:26,754 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. completed. 2023-07-17 02:11:26,755 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:26,755 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. completed. 2023-07-17 02:11:26,755 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:11:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:11:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:11:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:11:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,755 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,756 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 02:11:26,756 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:11:26,756 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 02:11:26,756 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:11:26,757 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,757 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 02:11:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:26,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:26,758 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:26,757 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,757 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 02:11:26,758 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 02:11:26,759 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:26,759 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 02:11:26,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:26,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:26,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:26,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:11:26,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 02:11:26,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:26,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:26,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:26,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:26,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:26,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:11:26,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 02:11:26,770 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-17 02:11:26,771 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:11:26,771 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:11:26,771 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,771 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:11:26,774 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:26,774 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,774 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:26,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:26,775 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:26,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:26,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:26,775 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,776 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:26,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,779 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:26,780 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,780 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,795 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,795 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:26,795 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:26,795 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:26,795 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:26,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:26,795 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:26,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:26,795 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:26,795 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:26,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:26,796 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:26,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,796 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:26,796 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:26,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:26,796 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:26,797 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:26,797 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,797 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:26,797 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:26,797 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,797 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:26,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:26,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,843 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:26,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 02:11:26,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:11:26,845 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 02:11:26,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,916 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 02:11:26,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,917 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:26,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689559886227Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689559886796 (+569 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689559886797 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689559886812 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689559886835 (+23 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689559886916 (+81 ms) 2023-07-17 02:11:26,920 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 02:11:26,926 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 692 msec 2023-07-17 02:11:27,345 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:27,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 02:11:27,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:11:27,372 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:27,377 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:27,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37335] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:11:27,378 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35673] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:11:27,389 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 02:11:27,390 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:27,393 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:11:27,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 02:11:27,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559887432 (current time:1689559887432). 2023-07-17 02:11:27,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:11:27,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x1def083b to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:27,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ce98944, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:27,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:27,448 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:27,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1def083b to 127.0.0.1:62514 2023-07-17 02:11:27,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:11:27,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x534e004a to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:27,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@368564c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:27,475 DEBUG [hconnection-0x66f678f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:27,479 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:27,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:27,488 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:27,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x534e004a to 127.0.0.1:62514 2023-07-17 02:11:27,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:11:27,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 02:11:27,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:11:27,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 02:11:27,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 02:11:27,497 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 02:11:27,499 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689560487499 2023-07-17 02:11:27,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 02:11:27,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 02:11:27,501 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:11:27,501 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:11:27,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 02:11:27,512 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 02:11:27,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-07-17 02:11:27,516 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 02:11:27,518 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689560487518 2023-07-17 02:11:27,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-17 02:11:27,563 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-17 02:11:27,563 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:27,564 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 02:11:27,564 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 02:11:27,565 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,565 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,568 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:27,568 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:27,568 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:27,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:27,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:27,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:27,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:27,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:27,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:27,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 02:11:27,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,570 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 02:11:27,571 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,572 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,572 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,572 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,572 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:11:27,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 02:11:27,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 02:11:27,573 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 02:11:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,573 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 02:11:27,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 02:11:27,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 02:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 02:11:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 02:11:27,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 02:11:27,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 02:11:27,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 02:11:27,583 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 02:11:27,583 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:27,585 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 02:11:27,585 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 02:11:27,585 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:27,585 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 02:11:27,586 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 02:11:27,586 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 02:11:27,586 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 02:11:27,586 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 02:11:27,586 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,586 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:27,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:27,587 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,587 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:27,587 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,587 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:27,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:27,588 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 02:11:27,589 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,589 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:27,589 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,589 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:27,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:27,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 02:11:27,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60793b4a[Count = 1] remaining members to acquire global barrier 2023-07-17 02:11:27,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:27,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:27,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:27,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:27,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 02:11:27,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:27,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 02:11:27,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60793b4a[Count = 0] remaining members to acquire global barrier 2023-07-17 02:11:27,595 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 02:11:27,595 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,600 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,600 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,601 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,601 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 02:11:27,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,601 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 02:11:27,601 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:27,601 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:27,601 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 02:11:27,601 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. started... 2023-07-17 02:11:27,601 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 02:11:27,601 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:11:27,601 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,602 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:11:27,602 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a44d38fa73ed7d9f2ace32b22aea5388 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 02:11:27,601 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:11:27,602 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,602 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:11:27,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 02:11:27,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:11:27,603 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:11:27,606 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:11:27,608 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:11:27,608 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:27,608 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. started... 2023-07-17 02:11:27,608 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 02:11:27,608 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:27,608 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e47fb4c61d46391733f9f51943fe68c8 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 02:11:27,608 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 02:11:27,706 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/.tmp/cf/ae149574299d486687547e14ebaa2099 2023-07-17 02:11:27,706 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/.tmp/cf/3ab4455ee5c740cba0b478b7b70f8ed8 2023-07-17 02:11:27,764 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/.tmp/cf/3ab4455ee5c740cba0b478b7b70f8ed8 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/cf/3ab4455ee5c740cba0b478b7b70f8ed8 2023-07-17 02:11:27,764 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/.tmp/cf/ae149574299d486687547e14ebaa2099 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/cf/ae149574299d486687547e14ebaa2099 2023-07-17 02:11:27,775 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/cf/3ab4455ee5c740cba0b478b7b70f8ed8, entries=2, sequenceid=6, filesize=5.0 K 2023-07-17 02:11:27,779 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e47fb4c61d46391733f9f51943fe68c8 in 171ms, sequenceid=6, compaction requested=false 2023-07-17 02:11:27,779 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-17 02:11:27,781 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e47fb4c61d46391733f9f51943fe68c8: 2023-07-17 02:11:27,781 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 02:11:27,781 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:11:27,781 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/cf/3ab4455ee5c740cba0b478b7b70f8ed8] hfiles 2023-07-17 02:11:27,782 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/cf/3ab4455ee5c740cba0b478b7b70f8ed8 for snapshot=snaptb0-testExportWithTargetName 2023-07-17 02:11:27,788 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/cf/ae149574299d486687547e14ebaa2099, entries=48, sequenceid=6, filesize=8.1 K 2023-07-17 02:11:27,792 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for a44d38fa73ed7d9f2ace32b22aea5388 in 190ms, sequenceid=6, compaction requested=false 2023-07-17 02:11:27,793 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a44d38fa73ed7d9f2ace32b22aea5388: 2023-07-17 02:11:27,794 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 02:11:27,794 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:11:27,794 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/cf/ae149574299d486687547e14ebaa2099] hfiles 2023-07-17 02:11:27,794 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/cf/ae149574299d486687547e14ebaa2099 for snapshot=snaptb0-testExportWithTargetName 2023-07-17 02:11:27,803 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:27,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 02:11:27,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:11:27,805 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 02:11:27,819 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. completed. 2023-07-17 02:11:27,819 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:11:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:11:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 02:11:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:11:27,821 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,821 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 02:11:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:27,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:27,821 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:27,821 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 02:11:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:27,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 02:11:27,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:27,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 02:11:27,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:11:27,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 02:11:27,832 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. completed. 2023-07-17 02:11:27,832 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:27,832 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:11:27,832 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:11:27,832 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,832 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 02:11:27,832 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:11:27,833 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,833 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 02:11:27,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:27,834 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:27,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:27,834 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 02:11:27,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:27,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 02:11:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 02:11:27,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:11:27,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 02:11:27,840 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-17 02:11:27,840 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:11:27,840 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:11:27,840 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-17 02:11:27,840 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:11:27,849 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,849 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:27,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,850 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,850 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:27,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:27,850 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,851 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:27,851 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:27,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:27,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:27,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:27,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:27,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,853 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 02:11:27,853 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:27,854 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 02:11:27,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,856 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:27,857 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 02:11:27,857 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,878 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:27,878 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:27,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:27,878 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:27,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:27,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:27,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:27,878 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:27,878 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:27,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:27,878 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:27,878 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:27,879 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-17 02:11:27,879 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:27,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-17 02:11:27,878 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:27,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:27,880 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:27,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:27,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:27,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:27,880 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,881 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,881 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:27,881 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,881 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:27,881 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:27,881 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,881 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 02:11:27,966 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,967 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 02:11:27,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689559887500Consolidate snapshot: snaptb0-testExportWithTargetName at 1689559887879 (+379 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689559887880 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689559887885 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689559887907 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689559887966 (+59 ms) 2023-07-17 02:11:27,969 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 02:11:27,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 468 msec 2023-07-17 02:11:28,105 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:28,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 02:11:28,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:11:28,109 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109 2023-07-17 02:11:28,109 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39797, tgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109, rawTgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109, srcFsUri=hdfs://localhost:39797, srcDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:11:28,160 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:11:28,160 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1026424599_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 02:11:28,160 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1, snapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-17 02:11:28,186 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 02:11:28,280 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:28,281 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:28,281 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:28,282 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:29,337 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-3113696081205994985.jar 2023-07-17 02:11:29,338 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:29,345 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:29,432 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-1368955024511219035.jar 2023-07-17 02:11:29,433 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:29,434 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:29,435 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:29,435 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:29,436 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:29,437 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:29,437 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 02:11:29,438 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 02:11:29,438 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 02:11:29,439 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 02:11:29,440 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 02:11:29,440 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 02:11:29,441 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 02:11:29,441 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 02:11:29,442 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 02:11:29,443 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 02:11:29,447 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:11:29,448 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:11:29,448 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:11:29,448 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:11:29,449 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:11:29,450 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:11:29,450 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:11:30,718 WARN [Listener at jenkins-hbase4.apache.org/46125] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 02:11:30,728 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-17 02:11:30,738 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 02:11:31,032 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 02:11:31,441 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:11:31,441 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:11:31,706 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0001_000001 (auth:SIMPLE) 2023-07-17 02:11:37,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0001_000001 (auth:SIMPLE) 2023-07-17 02:11:39,555 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0001_000001 (auth:SIMPLE) 2023-07-17 02:11:42,753 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0001_000001 (auth:SIMPLE) 2023-07-17 02:11:44,860 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 02:11:44,863 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 02:11:44,875 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-17 02:11:44,875 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 02:11:44,876 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 02:11:44,876 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 02:11:44,877 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-17 02:11:44,877 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-17 02:11:44,877 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109/.hbase-snapshot/testExportWithTargetName 2023-07-17 02:11:44,878 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-17 02:11:44,878 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559888109/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-17 02:11:44,891 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-17 02:11:44,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-17 02:11:44,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-17 02:11:44,909 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559904909"}]},"ts":"1689559904909"} 2023-07-17 02:11:44,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 02:11:44,911 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-17 02:11:44,913 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-17 02:11:44,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e47fb4c61d46391733f9f51943fe68c8, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a44d38fa73ed7d9f2ace32b22aea5388, UNASSIGN}] 2023-07-17 02:11:44,918 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a44d38fa73ed7d9f2ace32b22aea5388, UNASSIGN 2023-07-17 02:11:44,919 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e47fb4c61d46391733f9f51943fe68c8, UNASSIGN 2023-07-17 02:11:44,919 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a44d38fa73ed7d9f2ace32b22aea5388, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:44,920 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e47fb4c61d46391733f9f51943fe68c8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:44,920 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559904919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559904919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559904919"}]},"ts":"1689559904919"} 2023-07-17 02:11:44,920 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559904920"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559904920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559904920"}]},"ts":"1689559904920"} 2023-07-17 02:11:44,922 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure a44d38fa73ed7d9f2ace32b22aea5388, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:11:44,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure e47fb4c61d46391733f9f51943fe68c8, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:11:45,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 02:11:45,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:45,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:45,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e47fb4c61d46391733f9f51943fe68c8, disabling compactions & flushes 2023-07-17 02:11:45,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a44d38fa73ed7d9f2ace32b22aea5388, disabling compactions & flushes 2023-07-17 02:11:45,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:45,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:45,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:45,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:45,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. after waiting 0 ms 2023-07-17 02:11:45,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. after waiting 0 ms 2023-07-17 02:11:45,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:45,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:45,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:11:45,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:11:45,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:11:45,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:11:45,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8. 2023-07-17 02:11:45,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388. 2023-07-17 02:11:45,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e47fb4c61d46391733f9f51943fe68c8: 2023-07-17 02:11:45,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a44d38fa73ed7d9f2ace32b22aea5388: 2023-07-17 02:11:45,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:45,100 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=a44d38fa73ed7d9f2ace32b22aea5388, regionState=CLOSED 2023-07-17 02:11:45,100 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559905100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559905100"}]},"ts":"1689559905100"} 2023-07-17 02:11:45,101 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:45,101 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=e47fb4c61d46391733f9f51943fe68c8, regionState=CLOSED 2023-07-17 02:11:45,102 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689559905101"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559905101"}]},"ts":"1689559905101"} 2023-07-17 02:11:45,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-17 02:11:45,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure a44d38fa73ed7d9f2ace32b22aea5388, server=jenkins-hbase4.apache.org,35673,1689559874442 in 180 msec 2023-07-17 02:11:45,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-17 02:11:45,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure e47fb4c61d46391733f9f51943fe68c8, server=jenkins-hbase4.apache.org,37335,1689559874362 in 180 msec 2023-07-17 02:11:45,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a44d38fa73ed7d9f2ace32b22aea5388, UNASSIGN in 189 msec 2023-07-17 02:11:45,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-17 02:11:45,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e47fb4c61d46391733f9f51943fe68c8, UNASSIGN in 190 msec 2023-07-17 02:11:45,110 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559905110"}]},"ts":"1689559905110"} 2023-07-17 02:11:45,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-17 02:11:45,113 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-17 02:11:45,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 215 msec 2023-07-17 02:11:45,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 02:11:45,213 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-17 02:11:45,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-17 02:11:45,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 02:11:45,229 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 02:11:45,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-17 02:11:45,232 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 02:11:45,235 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-17 02:11:45,239 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 02:11:45,239 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 02:11:45,239 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 02:11:45,239 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 02:11:45,240 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:45,240 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:45,241 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:45,241 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:45,241 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 02:11:45,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 02:11:45,242 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 02:11:45,242 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:45,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 02:11:45,242 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 02:11:45,242 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 02:11:45,242 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 02:11:45,242 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 02:11:45,242 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:45,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 02:11:45,246 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/recovered.edits] 2023-07-17 02:11:45,246 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/recovered.edits] 2023-07-17 02:11:45,258 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/cf/ae149574299d486687547e14ebaa2099 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/cf/ae149574299d486687547e14ebaa2099 2023-07-17 02:11:45,258 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/cf/3ab4455ee5c740cba0b478b7b70f8ed8 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/cf/3ab4455ee5c740cba0b478b7b70f8ed8 2023-07-17 02:11:45,272 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388/recovered.edits/9.seqid 2023-07-17 02:11:45,272 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8/recovered.edits/9.seqid 2023-07-17 02:11:45,273 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/a44d38fa73ed7d9f2ace32b22aea5388 2023-07-17 02:11:45,274 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportWithTargetName/e47fb4c61d46391733f9f51943fe68c8 2023-07-17 02:11:45,274 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 02:11:45,277 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 02:11:45,300 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-17 02:11:45,303 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-17 02:11:45,305 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 02:11:45,305 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-17 02:11:45,305 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559905305"}]},"ts":"9223372036854775807"} 2023-07-17 02:11:45,305 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559905305"}]},"ts":"9223372036854775807"} 2023-07-17 02:11:45,308 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 02:11:45,308 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e47fb4c61d46391733f9f51943fe68c8, NAME => 'testtb-testExportWithTargetName,,1689559884987.e47fb4c61d46391733f9f51943fe68c8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a44d38fa73ed7d9f2ace32b22aea5388, NAME => 'testtb-testExportWithTargetName,1,1689559884987.a44d38fa73ed7d9f2ace32b22aea5388.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 02:11:45,308 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-17 02:11:45,308 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689559905308"}]},"ts":"9223372036854775807"} 2023-07-17 02:11:45,310 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-17 02:11:45,312 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 02:11:45,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 92 msec 2023-07-17 02:11:45,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 02:11:45,347 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-17 02:11:45,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-17 02:11:45,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-17 02:11:45,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-17 02:11:45,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-17 02:11:45,414 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=753 (was 706) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:53740 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:53888 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:34741 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-10340293_1 at /127.0.0.1:57334 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:44455 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:57354 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-10340293_1 at /127.0.0.1:53864 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 911) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=385 (was 384) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=2901 (was 4652) 2023-07-17 02:11:45,415 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-17 02:11:45,442 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=385, ProcessCount=179, AvailableMemoryMB=2900 2023-07-17 02:11:45,442 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-17 02:11:45,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 02:11:45,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-17 02:11:45,450 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 02:11:45,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-17 02:11:45,452 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 02:11:45,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 02:11:45,455 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:11:45,455 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:11:45,455 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb empty. 2023-07-17 02:11:45,455 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72 empty. 2023-07-17 02:11:45,456 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:11:45,456 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:11:45,456 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 02:11:45,473 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 02:11:45,474 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8855dec0a552aaf0bd194247be4e6feb, NAME => 'testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:11:45,475 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b2e6d8791fd2e8c9779c1c27625d5c72, NAME => 'testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:11:45,503 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:45,503 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:45,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b2e6d8791fd2e8c9779c1c27625d5c72, disabling compactions & flushes 2023-07-17 02:11:45,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8855dec0a552aaf0bd194247be4e6feb, disabling compactions & flushes 2023-07-17 02:11:45,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:45,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:45,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:45,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:45,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. after waiting 0 ms 2023-07-17 02:11:45,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. after waiting 0 ms 2023-07-17 02:11:45,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:45,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:45,513 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:45,513 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:45,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b2e6d8791fd2e8c9779c1c27625d5c72: 2023-07-17 02:11:45,513 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8855dec0a552aaf0bd194247be4e6feb: 2023-07-17 02:11:45,517 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 02:11:45,518 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559905518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559905518"}]},"ts":"1689559905518"} 2023-07-17 02:11:45,518 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559905518"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559905518"}]},"ts":"1689559905518"} 2023-07-17 02:11:45,526 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 02:11:45,528 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 02:11:45,528 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559905528"}]},"ts":"1689559905528"} 2023-07-17 02:11:45,530 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 02:11:45,535 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:11:45,536 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:11:45,537 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:11:45,537 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:11:45,537 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:11:45,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8855dec0a552aaf0bd194247be4e6feb, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b2e6d8791fd2e8c9779c1c27625d5c72, ASSIGN}] 2023-07-17 02:11:45,541 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b2e6d8791fd2e8c9779c1c27625d5c72, ASSIGN 2023-07-17 02:11:45,541 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8855dec0a552aaf0bd194247be4e6feb, ASSIGN 2023-07-17 02:11:45,542 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b2e6d8791fd2e8c9779c1c27625d5c72, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37335,1689559874362; forceNewPlan=false, retain=false 2023-07-17 02:11:45,543 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8855dec0a552aaf0bd194247be4e6feb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45215,1689559874524; forceNewPlan=false, retain=false 2023-07-17 02:11:45,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 02:11:45,693 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 02:11:45,695 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8855dec0a552aaf0bd194247be4e6feb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:45,695 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b2e6d8791fd2e8c9779c1c27625d5c72, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:45,696 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559905695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559905695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559905695"}]},"ts":"1689559905695"} 2023-07-17 02:11:45,696 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559905695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559905695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559905695"}]},"ts":"1689559905695"} 2023-07-17 02:11:45,698 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 8855dec0a552aaf0bd194247be4e6feb, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:11:45,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure b2e6d8791fd2e8c9779c1c27625d5c72, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:11:45,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 02:11:45,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:45,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b2e6d8791fd2e8c9779c1c27625d5c72, NAME => 'testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 02:11:45,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:45,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8855dec0a552aaf0bd194247be4e6feb, NAME => 'testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 02:11:45,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. service=AccessControlService 2023-07-17 02:11:45,861 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:45,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:11:45,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:45,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:11:45,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:11:45,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. service=AccessControlService 2023-07-17 02:11:45,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:11:45,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:11:45,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:11:45,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:11:45,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:11:45,863 INFO [StoreOpener-b2e6d8791fd2e8c9779c1c27625d5c72-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:11:45,864 INFO [StoreOpener-8855dec0a552aaf0bd194247be4e6feb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:11:45,865 DEBUG [StoreOpener-b2e6d8791fd2e8c9779c1c27625d5c72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/cf 2023-07-17 02:11:45,865 DEBUG [StoreOpener-8855dec0a552aaf0bd194247be4e6feb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/cf 2023-07-17 02:11:45,866 DEBUG [StoreOpener-8855dec0a552aaf0bd194247be4e6feb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/cf 2023-07-17 02:11:45,866 DEBUG [StoreOpener-b2e6d8791fd2e8c9779c1c27625d5c72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/cf 2023-07-17 02:11:45,866 INFO [StoreOpener-8855dec0a552aaf0bd194247be4e6feb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8855dec0a552aaf0bd194247be4e6feb columnFamilyName cf 2023-07-17 02:11:45,866 INFO [StoreOpener-b2e6d8791fd2e8c9779c1c27625d5c72-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2e6d8791fd2e8c9779c1c27625d5c72 columnFamilyName cf 2023-07-17 02:11:45,867 INFO [StoreOpener-8855dec0a552aaf0bd194247be4e6feb-1] regionserver.HStore(310): Store=8855dec0a552aaf0bd194247be4e6feb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:45,868 INFO [StoreOpener-b2e6d8791fd2e8c9779c1c27625d5c72-1] regionserver.HStore(310): Store=b2e6d8791fd2e8c9779c1c27625d5c72/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:11:45,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:11:45,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:11:45,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:11:45,870 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:11:45,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:11:45,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:11:45,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:11:45,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:11:45,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b2e6d8791fd2e8c9779c1c27625d5c72; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67863857, jitterRate=0.011250272393226624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:11:45,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b2e6d8791fd2e8c9779c1c27625d5c72: 2023-07-17 02:11:45,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8855dec0a552aaf0bd194247be4e6feb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62986951, jitterRate=-0.061421290040016174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:11:45,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8855dec0a552aaf0bd194247be4e6feb: 2023-07-17 02:11:45,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72., pid=31, masterSystemTime=1689559905854 2023-07-17 02:11:45,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb., pid=30, masterSystemTime=1689559905852 2023-07-17 02:11:45,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:45,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:45,880 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=8855dec0a552aaf0bd194247be4e6feb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:45,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:45,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:45,880 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559905880"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559905880"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559905880"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559905880"}]},"ts":"1689559905880"} 2023-07-17 02:11:45,881 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b2e6d8791fd2e8c9779c1c27625d5c72, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:45,881 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559905881"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559905881"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559905881"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559905881"}]},"ts":"1689559905881"} 2023-07-17 02:11:45,885 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-17 02:11:45,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 8855dec0a552aaf0bd194247be4e6feb, server=jenkins-hbase4.apache.org,45215,1689559874524 in 184 msec 2023-07-17 02:11:45,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-17 02:11:45,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure b2e6d8791fd2e8c9779c1c27625d5c72, server=jenkins-hbase4.apache.org,37335,1689559874362 in 185 msec 2023-07-17 02:11:45,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8855dec0a552aaf0bd194247be4e6feb, ASSIGN in 350 msec 2023-07-17 02:11:45,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-17 02:11:45,893 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b2e6d8791fd2e8c9779c1c27625d5c72, ASSIGN in 353 msec 2023-07-17 02:11:45,894 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 02:11:45,894 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559905894"}]},"ts":"1689559905894"} 2023-07-17 02:11:45,896 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 02:11:45,898 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 02:11:45,899 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-17 02:11:45,901 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 02:11:45,903 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:45,903 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:45,903 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:45,903 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:11:45,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 02:11:45,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 02:11:45,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 02:11:45,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 02:11:45,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 462 msec 2023-07-17 02:11:46,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 02:11:46,056 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-17 02:11:46,056 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-17 02:11:46,056 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:11:46,060 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-17 02:11:46,060 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:11:46,060 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-17 02:11:46,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:11:46,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559906064 (current time:1689559906064). 2023-07-17 02:11:46,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:11:46,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x40c81acc to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:46,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48066346, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:46,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:46,073 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:46,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40c81acc to 127.0.0.1:62514 2023-07-17 02:11:46,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:11:46,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x21d03875 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:46,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21ce48f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:46,081 DEBUG [hconnection-0x5aa913d5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:46,084 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:46,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:46,090 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:46,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21d03875 to 127.0.0.1:62514 2023-07-17 02:11:46,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:11:46,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 02:11:46,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:11:46,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:11:46,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:11:46,096 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:11:46,097 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689560506097 2023-07-17 02:11:46,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:11:46,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 02:11:46,098 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:11:46,098 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:11:46,099 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:11:46,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 02:11:46,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-17 02:11:46,102 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 02:11:46,103 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689560506103 2023-07-17 02:11:46,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,118 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-17 02:11:46,118 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:46,120 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 02:11:46,120 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 02:11:46,121 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,121 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,124 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,124 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,124 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,124 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,125 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,125 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,126 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,126 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:11:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 02:11:46,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,126 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 02:11:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 02:11:46,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 02:11:46,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 02:11:46,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 02:11:46,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,127 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 02:11:46,127 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:46,128 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,128 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 02:11:46,128 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:46,130 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 02:11:46,130 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 02:11:46,130 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 02:11:46,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,130 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 02:11:46,130 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 02:11:46,130 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:46,130 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 02:11:46,134 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 02:11:46,136 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,132 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 02:11:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 02:11:46,136 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 02:11:46,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,142 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,143 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:46,143 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,144 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,144 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,144 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:46,144 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,144 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:46,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 02:11:46,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28515f75[Count = 1] remaining members to acquire global barrier 2023-07-17 02:11:46,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 02:11:46,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28515f75[Count = 0] remaining members to acquire global barrier 2023-07-17 02:11:46,150 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 02:11:46,150 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,151 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,151 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,151 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,152 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,152 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:11:46,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,152 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:11:46,152 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:11:46,152 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 02:11:46,152 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:11:46,152 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,152 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:11:46,153 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 02:11:46,153 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:46,154 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 02:11:46,160 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:11:46,160 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:46,160 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:11:46,160 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:11:46,160 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:11:46,160 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. started... 2023-07-17 02:11:46,160 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:46,160 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. started... 2023-07-17 02:11:46,162 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b2e6d8791fd2e8c9779c1c27625d5c72: 2023-07-17 02:11:46,162 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8855dec0a552aaf0bd194247be4e6feb: 2023-07-17 02:11:46,162 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,162 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,162 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:11:46,162 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:11:46,162 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:11:46,162 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:11:46,185 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. completed. 2023-07-17 02:11:46,185 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:46,185 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:11:46,188 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:11:46,188 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,188 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 02:11:46,188 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:11:46,191 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 02:11:46,191 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:46,191 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 02:11:46,191 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,192 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. completed. 2023-07-17 02:11:46,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,192 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:46,193 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:11:46,193 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:11:46,193 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,193 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 02:11:46,193 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:11:46,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,195 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,198 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:46,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,199 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 02:11:46,199 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:46,199 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 02:11:46,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:11:46,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:11:46,201 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 02:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45215,1689559874524': 2023-07-17 02:11:46,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 02:11:46,215 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-17 02:11:46,215 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:11:46,215 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:11:46,215 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,215 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:11:46,218 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,218 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,218 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,218 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,218 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,218 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,219 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,221 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,222 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,223 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,226 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,227 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,227 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,231 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,231 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,231 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,231 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,231 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,232 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:46,232 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,231 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,231 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,233 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,233 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,232 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 02:11:46,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,355 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 02:11:46,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689559906097Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689559906234 (+137 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689559906234Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689559906247 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689559906281 (+34 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689559906354 (+73 ms) 2023-07-17 02:11:46,358 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 02:11:46,361 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 260 msec 2023-07-17 02:11:46,401 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:46,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:11:46,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:11:46,415 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:46,420 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:46,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37335] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:11:46,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45215] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:11:46,428 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 02:11:46,428 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:46,430 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:11:46,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:11:46,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559906448 (current time:1689559906448). 2023-07-17 02:11:46,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:11:46,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x320960b6 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:46,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a06df6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:46,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:46,460 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60196, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:46,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x320960b6 to 127.0.0.1:62514 2023-07-17 02:11:46,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:11:46,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x49679acf to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:11:46,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c931b46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:11:46,472 DEBUG [hconnection-0x110e7bb6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:46,473 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:46,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:11:46,479 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:11:46,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49679acf to 127.0.0.1:62514 2023-07-17 02:11:46,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:11:46,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 02:11:46,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:11:46,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:11:46,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:11:46,485 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:11:46,486 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689560506486 2023-07-17 02:11:46,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:11:46,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 02:11:46,487 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:11:46,488 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:11:46,489 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:11:46,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 02:11:46,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-17 02:11:46,491 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 02:11:46,492 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689560506492 2023-07-17 02:11:46,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-17 02:11:46,503 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-17 02:11:46,503 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:46,505 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 02:11:46,505 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 02:11:46,505 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,505 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,507 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,507 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,507 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,507 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,508 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,508 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,508 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,508 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:11:46,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 02:11:46,509 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 02:11:46,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 02:11:46,510 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 02:11:46,510 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 02:11:46,510 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:46,509 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:46,511 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 02:11:46,512 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 02:11:46,510 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:11:46,512 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 02:11:46,512 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 02:11:46,513 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 02:11:46,513 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 02:11:46,513 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 02:11:46,513 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 02:11:46,513 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 02:11:46,514 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,514 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,515 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,515 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,515 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,515 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:46,515 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,515 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,515 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,516 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,516 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:11:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 02:11:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 02:11:46,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1db825e[Count = 1] remaining members to acquire global barrier 2023-07-17 02:11:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 02:11:46,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 02:11:46,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1db825e[Count = 0] remaining members to acquire global barrier 2023-07-17 02:11:46,519 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 02:11:46,519 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:11:46,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,521 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:11:46,521 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:11:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,521 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:46,521 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:11:46,521 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. started... 2023-07-17 02:11:46,521 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,521 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:11:46,521 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:11:46,521 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 02:11:46,521 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:11:46,521 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:46,522 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:11:46,522 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. started... 2023-07-17 02:11:46,521 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b2e6d8791fd2e8c9779c1c27625d5c72 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-17 02:11:46,521 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:11:46,522 INFO [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8855dec0a552aaf0bd194247be4e6feb 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-17 02:11:46,529 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 02:11:46,529 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:46,529 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 02:11:46,541 INFO [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/.tmp/cf/5ffc11f7e52e489ea46f5a1af836a820 2023-07-17 02:11:46,542 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/.tmp/cf/b0dd8f25e4334837b97bd4c3fab233f9 2023-07-17 02:11:46,550 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/.tmp/cf/5ffc11f7e52e489ea46f5a1af836a820 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/cf/5ffc11f7e52e489ea46f5a1af836a820 2023-07-17 02:11:46,551 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/.tmp/cf/b0dd8f25e4334837b97bd4c3fab233f9 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/cf/b0dd8f25e4334837b97bd4c3fab233f9 2023-07-17 02:11:46,556 INFO [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/cf/5ffc11f7e52e489ea46f5a1af836a820, entries=5, sequenceid=6, filesize=5.2 K 2023-07-17 02:11:46,558 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/cf/b0dd8f25e4334837b97bd4c3fab233f9, entries=45, sequenceid=6, filesize=7.9 K 2023-07-17 02:11:46,559 INFO [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 8855dec0a552aaf0bd194247be4e6feb in 37ms, sequenceid=6, compaction requested=false 2023-07-17 02:11:46,559 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 02:11:46,559 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for b2e6d8791fd2e8c9779c1c27625d5c72 in 38ms, sequenceid=6, compaction requested=false 2023-07-17 02:11:46,560 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 02:11:46,561 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8855dec0a552aaf0bd194247be4e6feb: 2023-07-17 02:11:46,561 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b2e6d8791fd2e8c9779c1c27625d5c72: 2023-07-17 02:11:46,561 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 02:11:46,561 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 02:11:46,561 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:11:46,561 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:11:46,562 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/cf/5ffc11f7e52e489ea46f5a1af836a820] hfiles 2023-07-17 02:11:46,562 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/cf/b0dd8f25e4334837b97bd4c3fab233f9] hfiles 2023-07-17 02:11:46,562 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/cf/5ffc11f7e52e489ea46f5a1af836a820 for snapshot=snaptb0-testExportFileSystemState 2023-07-17 02:11:46,562 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/cf/b0dd8f25e4334837b97bd4c3fab233f9 for snapshot=snaptb0-testExportFileSystemState 2023-07-17 02:11:46,579 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. completed. 2023-07-17 02:11:46,579 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. completed. 2023-07-17 02:11:46,579 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:11:46,579 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:11:46,579 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:11:46,584 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 02:11:46,584 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 02:11:46,584 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:46,584 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,584 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 02:11:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,584 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:46,585 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,586 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 02:11:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 02:11:46,588 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:11:46,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:11:46,589 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:11:46,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 02:11:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:11:46,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 02:11:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 02:11:46,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 02:11:46,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45215,1689559874524': 2023-07-17 02:11:46,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 02:11:46,594 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-17 02:11:46,594 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:11:46,594 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:11:46,594 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-17 02:11:46,595 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:11:46,596 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,596 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,597 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,597 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,596 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,596 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,597 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:11:46,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:11:46,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,603 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 02:11:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,604 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:11:46,605 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 02:11:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:11:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 02:11:46,607 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,607 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,607 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,612 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,612 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-17 02:11:46,612 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:11:46,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,614 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:11:46,614 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:11:46,614 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,614 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:11:46,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,614 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:11:46,614 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,614 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:11:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:11:46,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:11:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:11:46,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,669 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 02:11:46,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,670 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689559906486Consolidate snapshot: snaptb0-testExportFileSystemState at 1689559906614 (+128 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689559906614Writing data manifest for snaptb0-testExportFileSystemState at 1689559906619 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689559906634 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689559906669 (+35 ms) 2023-07-17 02:11:46,672 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 02:11:46,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 185 msec 2023-07-17 02:11:46,789 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:11:46,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:11:46,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:11:46,793 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793 2023-07-17 02:11:46,793 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39797, tgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793, rawTgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793, srcFsUri=hdfs://localhost:39797, srcDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:11:46,825 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:11:46,826 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1604743678_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,826 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1, snapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-17 02:11:46,856 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 02:11:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:46,933 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:46,933 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:47,893 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-8367429520515424259.jar 2023-07-17 02:11:47,894 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:47,894 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:47,964 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-1264225137138200156.jar 2023-07-17 02:11:47,965 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:47,965 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:47,966 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:47,966 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:47,966 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:47,967 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 02:11:47,967 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 02:11:47,968 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 02:11:47,968 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 02:11:47,968 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 02:11:47,969 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 02:11:47,969 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 02:11:47,970 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 02:11:47,970 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 02:11:47,970 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 02:11:47,971 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 02:11:47,972 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:11:47,972 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:11:47,973 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:11:47,973 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:11:47,973 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:11:47,974 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:11:47,974 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:11:48,478 WARN [Listener at jenkins-hbase4.apache.org/46125] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 02:11:48,481 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-17 02:11:48,484 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 02:11:48,972 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:11:48,976 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:11:48,983 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0001_000001 (auth:SIMPLE) 2023-07-17 02:11:49,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0002_000001 (auth:SIMPLE) 2023-07-17 02:11:50,720 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 02:11:55,095 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0002_000001 (auth:SIMPLE) 2023-07-17 02:11:57,326 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0002_000001 (auth:SIMPLE) 2023-07-17 02:12:00,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0002_000001 (auth:SIMPLE) 2023-07-17 02:12:01,719 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 02:12:01,722 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 02:12:01,730 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-17 02:12:01,731 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 02:12:01,731 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 02:12:01,731 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 02:12:01,732 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 02:12:01,732 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 02:12:01,732 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 02:12:01,732 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 02:12:01,732 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559906793/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 02:12:01,740 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-17 02:12:01,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-17 02:12:01,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-17 02:12:01,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 02:12:01,745 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559921745"}]},"ts":"1689559921745"} 2023-07-17 02:12:01,747 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 02:12:01,748 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-17 02:12:01,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8855dec0a552aaf0bd194247be4e6feb, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b2e6d8791fd2e8c9779c1c27625d5c72, UNASSIGN}] 2023-07-17 02:12:01,751 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8855dec0a552aaf0bd194247be4e6feb, UNASSIGN 2023-07-17 02:12:01,751 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b2e6d8791fd2e8c9779c1c27625d5c72, UNASSIGN 2023-07-17 02:12:01,752 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8855dec0a552aaf0bd194247be4e6feb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:01,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b2e6d8791fd2e8c9779c1c27625d5c72, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:01,752 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559921752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559921752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559921752"}]},"ts":"1689559921752"} 2023-07-17 02:12:01,752 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559921752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559921752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559921752"}]},"ts":"1689559921752"} 2023-07-17 02:12:01,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 8855dec0a552aaf0bd194247be4e6feb, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:12:01,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure b2e6d8791fd2e8c9779c1c27625d5c72, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:12:01,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 02:12:01,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:12:01,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8855dec0a552aaf0bd194247be4e6feb, disabling compactions & flushes 2023-07-17 02:12:01,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:12:01,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:12:01,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. after waiting 0 ms 2023-07-17 02:12:01,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:12:01,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:12:01,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b2e6d8791fd2e8c9779c1c27625d5c72, disabling compactions & flushes 2023-07-17 02:12:01,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:12:01,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:12:01,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. after waiting 0 ms 2023-07-17 02:12:01,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:12:01,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:12:01,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:12:01,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:12:01,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:12:01,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb. 2023-07-17 02:12:01,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72. 2023-07-17 02:12:01,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8855dec0a552aaf0bd194247be4e6feb: 2023-07-17 02:12:01,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b2e6d8791fd2e8c9779c1c27625d5c72: 2023-07-17 02:12:01,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:12:01,928 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8855dec0a552aaf0bd194247be4e6feb, regionState=CLOSED 2023-07-17 02:12:01,928 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559921928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559921928"}]},"ts":"1689559921928"} 2023-07-17 02:12:01,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:12:01,928 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b2e6d8791fd2e8c9779c1c27625d5c72, regionState=CLOSED 2023-07-17 02:12:01,929 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689559921928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559921928"}]},"ts":"1689559921928"} 2023-07-17 02:12:01,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-17 02:12:01,931 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 8855dec0a552aaf0bd194247be4e6feb, server=jenkins-hbase4.apache.org,45215,1689559874524 in 175 msec 2023-07-17 02:12:01,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-17 02:12:01,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure b2e6d8791fd2e8c9779c1c27625d5c72, server=jenkins-hbase4.apache.org,37335,1689559874362 in 175 msec 2023-07-17 02:12:01,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=8855dec0a552aaf0bd194247be4e6feb, UNASSIGN in 182 msec 2023-07-17 02:12:01,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-17 02:12:01,934 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b2e6d8791fd2e8c9779c1c27625d5c72, UNASSIGN in 184 msec 2023-07-17 02:12:01,935 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559921935"}]},"ts":"1689559921935"} 2023-07-17 02:12:01,936 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 02:12:01,937 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-17 02:12:01,940 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 198 msec 2023-07-17 02:12:02,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 02:12:02,047 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-17 02:12:02,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-17 02:12:02,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 02:12:02,052 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 02:12:02,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-17 02:12:02,053 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 02:12:02,054 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-17 02:12:02,057 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 02:12:02,057 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 02:12:02,057 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 02:12:02,058 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 02:12:02,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 02:12:02,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 02:12:02,058 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:12:02,058 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:12:02,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 02:12:02,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 02:12:02,059 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 02:12:02,059 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 02:12:02,059 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 02:12:02,059 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:02,059 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:02,059 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:02,059 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 02:12:02,059 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:02,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 02:12:02,061 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/recovered.edits] 2023-07-17 02:12:02,061 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/recovered.edits] 2023-07-17 02:12:02,067 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/cf/b0dd8f25e4334837b97bd4c3fab233f9 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/cf/b0dd8f25e4334837b97bd4c3fab233f9 2023-07-17 02:12:02,067 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/cf/5ffc11f7e52e489ea46f5a1af836a820 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/cf/5ffc11f7e52e489ea46f5a1af836a820 2023-07-17 02:12:02,071 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb/recovered.edits/9.seqid 2023-07-17 02:12:02,071 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72/recovered.edits/9.seqid 2023-07-17 02:12:02,071 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/8855dec0a552aaf0bd194247be4e6feb 2023-07-17 02:12:02,071 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemState/b2e6d8791fd2e8c9779c1c27625d5c72 2023-07-17 02:12:02,072 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 02:12:02,074 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 02:12:02,076 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-17 02:12:02,079 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-17 02:12:02,080 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 02:12:02,080 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-17 02:12:02,081 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559922080"}]},"ts":"9223372036854775807"} 2023-07-17 02:12:02,081 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559922080"}]},"ts":"9223372036854775807"} 2023-07-17 02:12:02,083 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 02:12:02,083 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8855dec0a552aaf0bd194247be4e6feb, NAME => 'testtb-testExportFileSystemState,,1689559905444.8855dec0a552aaf0bd194247be4e6feb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b2e6d8791fd2e8c9779c1c27625d5c72, NAME => 'testtb-testExportFileSystemState,1,1689559905444.b2e6d8791fd2e8c9779c1c27625d5c72.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 02:12:02,083 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-17 02:12:02,083 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689559922083"}]},"ts":"9223372036854775807"} 2023-07-17 02:12:02,085 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-17 02:12:02,087 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 02:12:02,089 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 39 msec 2023-07-17 02:12:02,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 02:12:02,162 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-17 02:12:02,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-17 02:12:02,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-17 02:12:02,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-17 02:12:02,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-17 02:12:02,206 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=766 (was 753) Potentially hanging thread: Thread-1950 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-17702967_1 at /127.0.0.1:35642 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:41411 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:47824 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:36698 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:40638 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 918), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=390 (was 385) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=2699 (was 2900) 2023-07-17 02:12:02,206 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-17 02:12:02,227 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=390, ProcessCount=179, AvailableMemoryMB=2698 2023-07-17 02:12:02,227 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-17 02:12:02,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 02:12:02,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-17 02:12:02,235 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 02:12:02,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-17 02:12:02,236 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 02:12:02,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 02:12:02,239 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:02,239 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:02,240 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c empty. 2023-07-17 02:12:02,240 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77 empty. 2023-07-17 02:12:02,240 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:02,240 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:02,240 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 02:12:02,262 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-17 02:12:02,263 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => e99998b78016ac6ce3f80f96f2d6680c, NAME => 'testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:12:02,264 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3ccf90b000472ecb33e44c23810dea77, NAME => 'testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:12:02,290 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing e99998b78016ac6ce3f80f96f2d6680c, disabling compactions & flushes 2023-07-17 02:12:02,291 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 3ccf90b000472ecb33e44c23810dea77, disabling compactions & flushes 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. after waiting 0 ms 2023-07-17 02:12:02,291 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:02,291 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. after waiting 0 ms 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for e99998b78016ac6ce3f80f96f2d6680c: 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:02,291 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:02,291 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 3ccf90b000472ecb33e44c23810dea77: 2023-07-17 02:12:02,294 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 02:12:02,295 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559922295"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559922295"}]},"ts":"1689559922295"} 2023-07-17 02:12:02,295 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559922295"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559922295"}]},"ts":"1689559922295"} 2023-07-17 02:12:02,298 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 02:12:02,299 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 02:12:02,299 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559922299"}]},"ts":"1689559922299"} 2023-07-17 02:12:02,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-17 02:12:02,305 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:12:02,306 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:12:02,306 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:12:02,306 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:12:02,306 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:12:02,306 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e99998b78016ac6ce3f80f96f2d6680c, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ccf90b000472ecb33e44c23810dea77, ASSIGN}] 2023-07-17 02:12:02,309 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ccf90b000472ecb33e44c23810dea77, ASSIGN 2023-07-17 02:12:02,309 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e99998b78016ac6ce3f80f96f2d6680c, ASSIGN 2023-07-17 02:12:02,310 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e99998b78016ac6ce3f80f96f2d6680c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45215,1689559874524; forceNewPlan=false, retain=false 2023-07-17 02:12:02,310 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ccf90b000472ecb33e44c23810dea77, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35673,1689559874442; forceNewPlan=false, retain=false 2023-07-17 02:12:02,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 02:12:02,460 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 02:12:02,463 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e99998b78016ac6ce3f80f96f2d6680c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,463 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3ccf90b000472ecb33e44c23810dea77, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,463 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559922463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559922463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559922463"}]},"ts":"1689559922463"} 2023-07-17 02:12:02,463 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559922463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559922463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559922463"}]},"ts":"1689559922463"} 2023-07-17 02:12:02,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure e99998b78016ac6ce3f80f96f2d6680c, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:12:02,466 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 3ccf90b000472ecb33e44c23810dea77, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:12:02,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 02:12:02,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:02,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:02,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e99998b78016ac6ce3f80f96f2d6680c, NAME => 'testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 02:12:02,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ccf90b000472ecb33e44c23810dea77, NAME => 'testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 02:12:02,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. service=AccessControlService 2023-07-17 02:12:02,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. service=AccessControlService 2023-07-17 02:12:02,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:12:02,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:12:02,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:02,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:02,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:02,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:02,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:02,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:02,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:02,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:02,627 INFO [StoreOpener-3ccf90b000472ecb33e44c23810dea77-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:02,627 INFO [StoreOpener-e99998b78016ac6ce3f80f96f2d6680c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:02,629 DEBUG [StoreOpener-3ccf90b000472ecb33e44c23810dea77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/cf 2023-07-17 02:12:02,629 DEBUG [StoreOpener-e99998b78016ac6ce3f80f96f2d6680c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/cf 2023-07-17 02:12:02,629 DEBUG [StoreOpener-e99998b78016ac6ce3f80f96f2d6680c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/cf 2023-07-17 02:12:02,629 DEBUG [StoreOpener-3ccf90b000472ecb33e44c23810dea77-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/cf 2023-07-17 02:12:02,629 INFO [StoreOpener-e99998b78016ac6ce3f80f96f2d6680c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e99998b78016ac6ce3f80f96f2d6680c columnFamilyName cf 2023-07-17 02:12:02,629 INFO [StoreOpener-3ccf90b000472ecb33e44c23810dea77-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ccf90b000472ecb33e44c23810dea77 columnFamilyName cf 2023-07-17 02:12:02,630 INFO [StoreOpener-e99998b78016ac6ce3f80f96f2d6680c-1] regionserver.HStore(310): Store=e99998b78016ac6ce3f80f96f2d6680c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:12:02,630 INFO [StoreOpener-3ccf90b000472ecb33e44c23810dea77-1] regionserver.HStore(310): Store=3ccf90b000472ecb33e44c23810dea77/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:12:02,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:02,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:02,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:02,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:02,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:02,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:02,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:12:02,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:12:02,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e99998b78016ac6ce3f80f96f2d6680c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66702889, jitterRate=-0.006049498915672302}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:12:02,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e99998b78016ac6ce3f80f96f2d6680c: 2023-07-17 02:12:02,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3ccf90b000472ecb33e44c23810dea77; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61264344, jitterRate=-0.0870901346206665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:12:02,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3ccf90b000472ecb33e44c23810dea77: 2023-07-17 02:12:02,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c., pid=45, masterSystemTime=1689559922618 2023-07-17 02:12:02,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77., pid=46, masterSystemTime=1689559922618 2023-07-17 02:12:02,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:02,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:02,640 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e99998b78016ac6ce3f80f96f2d6680c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:02,640 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559922640"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559922640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559922640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559922640"}]},"ts":"1689559922640"} 2023-07-17 02:12:02,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:02,641 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3ccf90b000472ecb33e44c23810dea77, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,642 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559922641"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559922641"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559922641"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559922641"}]},"ts":"1689559922641"} 2023-07-17 02:12:02,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-17 02:12:02,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure e99998b78016ac6ce3f80f96f2d6680c, server=jenkins-hbase4.apache.org,45215,1689559874524 in 177 msec 2023-07-17 02:12:02,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e99998b78016ac6ce3f80f96f2d6680c, ASSIGN in 339 msec 2023-07-17 02:12:02,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-17 02:12:02,646 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 3ccf90b000472ecb33e44c23810dea77, server=jenkins-hbase4.apache.org,35673,1689559874442 in 178 msec 2023-07-17 02:12:02,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-17 02:12:02,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ccf90b000472ecb33e44c23810dea77, ASSIGN in 340 msec 2023-07-17 02:12:02,649 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 02:12:02,649 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559922649"}]},"ts":"1689559922649"} 2023-07-17 02:12:02,651 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-17 02:12:02,653 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 02:12:02,653 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-17 02:12:02,655 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 02:12:02,657 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:02,657 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:02,657 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:02,657 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:02,658 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:02,658 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:02,658 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:02,658 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:02,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 429 msec 2023-07-17 02:12:02,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 02:12:02,840 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-17 02:12:02,841 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-17 02:12:02,841 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:12:02,844 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-17 02:12:02,844 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:12:02,844 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-17 02:12:02,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 02:12:02,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559922847 (current time:1689559922847). 2023-07-17 02:12:02,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:12:02,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x4f722a12 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:02,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@806f350, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:02,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:02,859 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:02,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f722a12 to 127.0.0.1:62514 2023-07-17 02:12:02,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:02,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x39795f9b to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:02,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6705d01c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:02,868 DEBUG [hconnection-0x582623df-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:02,870 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:02,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:02,876 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:02,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39795f9b to 127.0.0.1:62514 2023-07-17 02:12:02,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:02,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 02:12:02,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:12:02,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 02:12:02,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 02:12:02,881 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 02:12:02,882 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689560522882 2023-07-17 02:12:02,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 02:12:02,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 02:12:02,883 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:12:02,883 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:12:02,886 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 02:12:02,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 02:12:02,887 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-17 02:12:02,888 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 02:12:02,889 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689560522889 2023-07-17 02:12:02,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,899 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-17 02:12:02,899 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:02,900 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 02:12:02,900 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 02:12:02,901 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,901 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,905 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:02,905 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:02,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:02,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:02,905 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:02,905 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,905 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,906 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,906 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,906 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:12:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 02:12:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 02:12:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 02:12:02,907 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 02:12:02,907 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 02:12:02,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,907 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 02:12:02,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,907 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 02:12:02,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,907 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:02,907 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 02:12:02,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,908 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 02:12:02,909 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 02:12:02,909 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 02:12:02,909 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 02:12:02,909 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:02,909 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:02,910 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 02:12:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 02:12:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 02:12:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 02:12:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 02:12:02,914 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 02:12:02,922 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,922 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:02,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:02,926 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,926 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,926 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,926 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:02,926 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:02,926 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,927 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:02,926 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,927 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:02,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:02,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:02,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 02:12:02,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77b5752f[Count = 1] remaining members to acquire global barrier 2023-07-17 02:12:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:02,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:02,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 02:12:02,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77b5752f[Count = 0] remaining members to acquire global barrier 2023-07-17 02:12:02,933 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 02:12:02,934 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,935 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,935 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,935 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,935 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 02:12:02,935 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 02:12:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 02:12:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 02:12:02,936 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:12:02,936 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,936 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:12:02,942 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:12:02,942 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:12:02,943 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:02,943 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:12:02,943 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:12:02,943 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. started... 2023-07-17 02:12:02,943 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:02,943 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. started... 2023-07-17 02:12:02,944 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e99998b78016ac6ce3f80f96f2d6680c: 2023-07-17 02:12:02,944 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3ccf90b000472ecb33e44c23810dea77: 2023-07-17 02:12:02,945 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 02:12:02,945 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:02,945 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,945 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 02:12:02,945 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,947 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:12:02,947 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:12:02,947 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:12:02,947 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:12:02,974 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. completed. 2023-07-17 02:12:02,974 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:02,974 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:12:02,974 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:12:02,974 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,974 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 02:12:02,974 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:12:02,975 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. completed. 2023-07-17 02:12:02,975 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:02,976 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:12:02,976 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:12:02,976 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,976 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 02:12:02,976 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:12:02,976 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,976 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 02:12:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:02,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:02,976 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:02,977 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 02:12:02,978 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,978 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 02:12:02,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:02,978 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:02,978 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 02:12:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45215,1689559874524': 2023-07-17 02:12:02,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 02:12:02,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:02,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,983 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:02,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 02:12:02,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:12:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,985 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:12:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:12:02,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 02:12:02,986 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-17 02:12:02,986 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:12:02,986 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:12:02,986 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,986 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:12:02,989 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,989 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:02,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,989 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,989 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:02,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,989 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:02,990 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:02,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:02,990 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:02,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,990 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,990 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:02,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,991 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,993 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,993 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,994 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:02,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,997 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,997 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,997 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:02,997 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:02,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:02,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:02,997 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:02,997 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:02,997 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:02,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:02,997 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,997 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:02,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:02,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:02,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:02,997 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:02,997 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:02,998 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:02,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:02,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:02,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:02,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:02,999 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:02,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:03,000 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:03,000 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:03,000 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,000 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,000 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:03,000 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:03,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-17 02:12:03,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:03,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 02:12:03,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:03,052 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:03,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689559922882Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689559922997 (+115 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689559922998 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689559923004 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689559923012 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689559923051 (+39 ms) 2023-07-17 02:12:03,055 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 02:12:03,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 172 msec 2023-07-17 02:12:03,185 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:03,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 02:12:03,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:12:03,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45215] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:12:03,195 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35673] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:12:03,198 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 02:12:03,199 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:03,199 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:12:03,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 02:12:03,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559923212 (current time:1689559923212). 2023-07-17 02:12:03,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:12:03,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x71adc0ed to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:03,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fe52ed5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:03,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:03,239 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:03,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71adc0ed to 127.0.0.1:62514 2023-07-17 02:12:03,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:03,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x393f97b8 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:03,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@260a92da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:03,254 DEBUG [hconnection-0x506f9348-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:03,258 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:03,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:03,264 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:03,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x393f97b8 to 127.0.0.1:62514 2023-07-17 02:12:03,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:03,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 02:12:03,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:12:03,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 02:12:03,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 02:12:03,273 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 02:12:03,274 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689560523274 2023-07-17 02:12:03,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 02:12:03,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 02:12:03,276 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:12:03,276 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:12:03,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 02:12:03,278 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 02:12:03,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-17 02:12:03,280 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 02:12:03,282 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689560523282 2023-07-17 02:12:03,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-17 02:12:03,305 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-17 02:12:03,305 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:03,307 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 02:12:03,307 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 02:12:03,308 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,308 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,309 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:03,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:03,309 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,309 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:03,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:03,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:03,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:03,309 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:03,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:03,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:03,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 02:12:03,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,311 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,311 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,311 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 02:12:03,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 02:12:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 02:12:03,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,312 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:03,312 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,314 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:12:03,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,314 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 02:12:03,314 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 02:12:03,314 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 02:12:03,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 02:12:03,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 02:12:03,315 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,316 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 02:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,316 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 02:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:03,316 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,316 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:03,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 02:12:03,317 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 02:12:03,317 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:03,318 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 02:12:03,318 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 02:12:03,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 02:12:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:03,318 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 02:12:03,318 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 02:12:03,318 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:03,320 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 02:12:03,320 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 02:12:03,320 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 02:12:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 02:12:03,323 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,324 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,324 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,324 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:03,324 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,324 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,324 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:03,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 02:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c022c0[Count = 1] remaining members to acquire global barrier 2023-07-17 02:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:03,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:03,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:03,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 02:12:03,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:03,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 02:12:03,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c022c0[Count = 0] remaining members to acquire global barrier 2023-07-17 02:12:03,327 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 02:12:03,327 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 02:12:03,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,329 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,329 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:12:03,329 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:12:03,329 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 02:12:03,329 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:03,329 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 02:12:03,330 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. started... 2023-07-17 02:12:03,330 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 02:12:03,330 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,330 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:03,330 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:12:03,330 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. started... 2023-07-17 02:12:03,330 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3ccf90b000472ecb33e44c23810dea77 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 02:12:03,330 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:12:03,330 INFO [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e99998b78016ac6ce3f80f96f2d6680c 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 02:12:03,330 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:12:03,330 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:12:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 02:12:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:03,333 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 02:12:03,357 INFO [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/.tmp/cf/4ffb1e959e424741abc76e42dc0bd611 2023-07-17 02:12:03,359 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/.tmp/cf/64ecd2da89fb49b39c699a8b11afb286 2023-07-17 02:12:03,366 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/.tmp/cf/4ffb1e959e424741abc76e42dc0bd611 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/cf/4ffb1e959e424741abc76e42dc0bd611 2023-07-17 02:12:03,367 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/.tmp/cf/64ecd2da89fb49b39c699a8b11afb286 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/cf/64ecd2da89fb49b39c699a8b11afb286 2023-07-17 02:12:03,373 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/cf/64ecd2da89fb49b39c699a8b11afb286, entries=48, sequenceid=6, filesize=8.1 K 2023-07-17 02:12:03,373 INFO [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/cf/4ffb1e959e424741abc76e42dc0bd611, entries=2, sequenceid=6, filesize=5.0 K 2023-07-17 02:12:03,374 INFO [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e99998b78016ac6ce3f80f96f2d6680c in 44ms, sequenceid=6, compaction requested=false 2023-07-17 02:12:03,374 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 3ccf90b000472ecb33e44c23810dea77 in 44ms, sequenceid=6, compaction requested=false 2023-07-17 02:12:03,374 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 02:12:03,374 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e99998b78016ac6ce3f80f96f2d6680c: 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3ccf90b000472ecb33e44c23810dea77: 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/cf/4ffb1e959e424741abc76e42dc0bd611] hfiles 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/cf/4ffb1e959e424741abc76e42dc0bd611 for snapshot=snaptb0-testConsecutiveExports 2023-07-17 02:12:03,376 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/cf/64ecd2da89fb49b39c699a8b11afb286] hfiles 2023-07-17 02:12:03,376 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/cf/64ecd2da89fb49b39c699a8b11afb286 for snapshot=snaptb0-testConsecutiveExports 2023-07-17 02:12:03,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 02:12:03,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:12:03,378 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:12:03,391 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. completed. 2023-07-17 02:12:03,391 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:03,391 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:12:03,391 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:12:03,391 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,391 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 02:12:03,391 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:12:03,393 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. completed. 2023-07-17 02:12:03,393 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:12:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:12:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 02:12:03,393 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:12:03,394 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,394 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 02:12:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:03,394 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:03,394 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 02:12:03,396 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:03,396 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 02:12:03,396 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:03,396 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 02:12:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 02:12:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 02:12:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45215,1689559874524': 2023-07-17 02:12:03,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 02:12:03,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:03,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:03,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:03,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:03,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 02:12:03,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:03,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 02:12:03,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:12:03,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 02:12:03,404 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-17 02:12:03,404 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:12:03,404 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:12:03,404 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-17 02:12:03,404 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:12:03,406 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,406 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:03,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:03,406 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,406 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,407 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:03,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,407 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:03,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,406 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,407 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 02:12:03,407 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:03,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:03,408 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 02:12:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:03,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 02:12:03,410 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,410 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,411 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,417 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:03,417 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,417 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,417 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,417 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:03,417 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:03,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:03,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:03,417 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-17 02:12:03,417 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:03,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-17 02:12:03,417 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,417 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:03,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:03,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:03,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:03,417 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:03,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:03,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:03,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:03,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:03,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:03,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:03,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:03,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:03,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:03,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:03,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:03,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 02:12:03,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,468 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689559923274Consolidate snapshot: snaptb0-testConsecutiveExports at 1689559923418 (+144 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689559923418Writing data manifest for snaptb0-testConsecutiveExports at 1689559923425 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689559923439 (+14 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689559923468 (+29 ms) 2023-07-17 02:12:03,472 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 02:12:03,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 197 msec 2023-07-17 02:12:03,578 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:03,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 02:12:03,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:12:03,579 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579 2023-07-17 02:12:03,580 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579, srcFsUri=hdfs://localhost:39797, srcDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:12:03,605 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:12:03,605 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2d2d551d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,605 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1, snapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 02:12:03,614 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 02:12:03,626 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:03,626 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:03,627 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:03,627 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:04,586 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-1882495051324687153.jar 2023-07-17 02:12:04,587 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:04,587 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:04,655 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-6371531566697576626.jar 2023-07-17 02:12:04,655 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:04,656 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:04,656 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:04,657 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:04,657 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:04,657 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:04,658 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 02:12:04,658 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 02:12:04,659 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 02:12:04,659 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 02:12:04,659 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 02:12:04,660 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 02:12:04,660 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 02:12:04,660 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 02:12:04,661 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 02:12:04,661 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 02:12:04,662 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:04,662 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:04,663 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:12:04,663 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:04,663 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:04,664 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:12:04,664 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:12:05,103 WARN [Listener at jenkins-hbase4.apache.org/46125] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 02:12:05,106 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 02:12:05,110 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 02:12:06,471 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:12:06,471 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:12:06,476 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0002_000001 (auth:SIMPLE) 2023-07-17 02:12:06,989 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0003_000001 (auth:SIMPLE) 2023-07-17 02:12:07,527 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 02:12:11,721 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0003_000001 (auth:SIMPLE) 2023-07-17 02:12:13,971 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0003_000001 (auth:SIMPLE) 2023-07-17 02:12:16,784 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0003_000001 (auth:SIMPLE) 2023-07-17 02:12:18,298 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 02:12:18,298 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 02:12:18,302 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 02:12:18,302 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 02:12:18,302 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 02:12:18,303 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 02:12:18,303 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 02:12:18,303 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 02:12:18,303 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@155b373d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 02:12:18,304 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 02:12:18,304 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 02:12:18,305 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579, srcFsUri=hdfs://localhost:39797, srcDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:12:18,327 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:12:18,328 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6a0b8182, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 02:12:18,328 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1, snapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 02:12:18,338 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 02:12:18,350 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:18,350 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:18,351 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:18,351 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:19,250 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-6494514578594451821.jar 2023-07-17 02:12:19,251 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:19,251 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:19,320 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-1320661278612272691.jar 2023-07-17 02:12:19,321 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:19,321 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:19,322 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:19,322 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:19,322 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:19,323 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:19,323 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 02:12:19,324 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 02:12:19,324 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 02:12:19,325 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 02:12:19,325 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 02:12:19,326 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 02:12:19,327 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 02:12:19,327 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 02:12:19,327 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 02:12:19,328 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 02:12:19,329 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:19,329 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:19,330 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:12:19,330 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:19,330 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:19,331 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:12:19,332 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:12:19,730 WARN [Listener at jenkins-hbase4.apache.org/46125] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 02:12:19,732 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 02:12:19,735 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 02:12:22,989 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:12:22,989 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:12:22,992 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0003_000001 (auth:SIMPLE) 2023-07-17 02:12:23,486 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0004_000001 (auth:SIMPLE) 2023-07-17 02:12:28,369 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0004_000001 (auth:SIMPLE) 2023-07-17 02:12:30,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0004_000001 (auth:SIMPLE) 2023-07-17 02:12:34,349 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0004_000001 (auth:SIMPLE) 2023-07-17 02:12:35,990 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 02:12:35,990 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 02:12:36,003 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 02:12:36,004 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 02:12:36,004 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 02:12:36,004 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 02:12:36,007 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 02:12:36,007 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 02:12:36,007 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@155b373d in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 02:12:36,008 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 02:12:36,008 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/local-export-1689559923579/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 02:12:36,025 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-17 02:12:36,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-17 02:12:36,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-17 02:12:36,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 02:12:36,032 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559956032"}]},"ts":"1689559956032"} 2023-07-17 02:12:36,048 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-17 02:12:36,051 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-17 02:12:36,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e99998b78016ac6ce3f80f96f2d6680c, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ccf90b000472ecb33e44c23810dea77, UNASSIGN}] 2023-07-17 02:12:36,054 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ccf90b000472ecb33e44c23810dea77, UNASSIGN 2023-07-17 02:12:36,056 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e99998b78016ac6ce3f80f96f2d6680c, UNASSIGN 2023-07-17 02:12:36,059 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3ccf90b000472ecb33e44c23810dea77, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:36,059 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559956059"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559956059"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559956059"}]},"ts":"1689559956059"} 2023-07-17 02:12:36,060 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=e99998b78016ac6ce3f80f96f2d6680c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:36,060 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559956060"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559956060"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559956060"}]},"ts":"1689559956060"} 2023-07-17 02:12:36,063 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 3ccf90b000472ecb33e44c23810dea77, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:12:36,064 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure e99998b78016ac6ce3f80f96f2d6680c, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:12:36,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 02:12:36,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:36,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:36,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3ccf90b000472ecb33e44c23810dea77, disabling compactions & flushes 2023-07-17 02:12:36,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e99998b78016ac6ce3f80f96f2d6680c, disabling compactions & flushes 2023-07-17 02:12:36,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:36,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:36,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:36,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:36,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. after waiting 0 ms 2023-07-17 02:12:36,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. after waiting 0 ms 2023-07-17 02:12:36,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:36,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:36,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:12:36,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:12:36,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:12:36,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c. 2023-07-17 02:12:36,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e99998b78016ac6ce3f80f96f2d6680c: 2023-07-17 02:12:36,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:12:36,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77. 2023-07-17 02:12:36,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3ccf90b000472ecb33e44c23810dea77: 2023-07-17 02:12:36,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:36,258 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=e99998b78016ac6ce3f80f96f2d6680c, regionState=CLOSED 2023-07-17 02:12:36,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559956258"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559956258"}]},"ts":"1689559956258"} 2023-07-17 02:12:36,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:36,259 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3ccf90b000472ecb33e44c23810dea77, regionState=CLOSED 2023-07-17 02:12:36,259 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689559956259"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559956259"}]},"ts":"1689559956259"} 2023-07-17 02:12:36,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-17 02:12:36,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure e99998b78016ac6ce3f80f96f2d6680c, server=jenkins-hbase4.apache.org,45215,1689559874524 in 196 msec 2023-07-17 02:12:36,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-17 02:12:36,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 3ccf90b000472ecb33e44c23810dea77, server=jenkins-hbase4.apache.org,35673,1689559874442 in 198 msec 2023-07-17 02:12:36,265 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=e99998b78016ac6ce3f80f96f2d6680c, UNASSIGN in 211 msec 2023-07-17 02:12:36,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-17 02:12:36,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3ccf90b000472ecb33e44c23810dea77, UNASSIGN in 212 msec 2023-07-17 02:12:36,268 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559956268"}]},"ts":"1689559956268"} 2023-07-17 02:12:36,269 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-17 02:12:36,271 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-17 02:12:36,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 246 msec 2023-07-17 02:12:36,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 02:12:36,347 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-17 02:12:36,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-17 02:12:36,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 02:12:36,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 02:12:36,354 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 02:12:36,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-17 02:12:36,360 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-17 02:12:36,362 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 02:12:36,362 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 02:12:36,362 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 02:12:36,363 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 02:12:36,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 02:12:36,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 02:12:36,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 02:12:36,363 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 02:12:36,366 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 02:12:36,366 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:36,366 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 02:12:36,366 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:36,366 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 02:12:36,366 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:36,366 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 02:12:36,366 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:36,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 02:12:36,379 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:36,381 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:36,382 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/recovered.edits] 2023-07-17 02:12:36,383 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/recovered.edits] 2023-07-17 02:12:36,387 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/cf/4ffb1e959e424741abc76e42dc0bd611 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/cf/4ffb1e959e424741abc76e42dc0bd611 2023-07-17 02:12:36,387 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/cf/64ecd2da89fb49b39c699a8b11afb286 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/cf/64ecd2da89fb49b39c699a8b11afb286 2023-07-17 02:12:36,391 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c/recovered.edits/9.seqid 2023-07-17 02:12:36,392 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/e99998b78016ac6ce3f80f96f2d6680c 2023-07-17 02:12:36,392 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77/recovered.edits/9.seqid 2023-07-17 02:12:36,393 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testConsecutiveExports/3ccf90b000472ecb33e44c23810dea77 2023-07-17 02:12:36,393 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 02:12:36,396 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 02:12:36,399 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-17 02:12:36,414 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-17 02:12:36,416 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 02:12:36,416 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-17 02:12:36,416 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559956416"}]},"ts":"9223372036854775807"} 2023-07-17 02:12:36,416 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559956416"}]},"ts":"9223372036854775807"} 2023-07-17 02:12:36,424 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 02:12:36,424 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e99998b78016ac6ce3f80f96f2d6680c, NAME => 'testtb-testConsecutiveExports,,1689559922229.e99998b78016ac6ce3f80f96f2d6680c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3ccf90b000472ecb33e44c23810dea77, NAME => 'testtb-testConsecutiveExports,1,1689559922229.3ccf90b000472ecb33e44c23810dea77.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 02:12:36,424 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-17 02:12:36,424 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689559956424"}]},"ts":"9223372036854775807"} 2023-07-17 02:12:36,438 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-17 02:12:36,443 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 02:12:36,451 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 95 msec 2023-07-17 02:12:36,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 02:12:36,470 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-17 02:12:36,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-17 02:12:36,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-17 02:12:36,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-17 02:12:36,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-17 02:12:36,517 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 766), OpenFileDescriptor=895 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=425 (was 390) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=2602 (was 2698) 2023-07-17 02:12:36,517 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-17 02:12:36,543 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=425, ProcessCount=181, AvailableMemoryMB=2600 2023-07-17 02:12:36,543 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-17 02:12:36,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 02:12:36,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:36,548 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 02:12:36,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-17 02:12:36,550 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 02:12:36,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 02:12:36,554 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:12:36,554 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:12:36,555 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a empty. 2023-07-17 02:12:36,555 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4 empty. 2023-07-17 02:12:36,556 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:12:36,556 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:12:36,556 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 02:12:36,576 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-17 02:12:36,577 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 408e08e78b1883eba73e6554b1890f1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:12:36,577 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 83fd289cd7b3b33d20bb3bfa1e86b9e4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:12:36,617 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:36,617 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 408e08e78b1883eba73e6554b1890f1a, disabling compactions & flushes 2023-07-17 02:12:36,617 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:36,617 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:36,617 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. after waiting 0 ms 2023-07-17 02:12:36,617 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:36,617 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:36,617 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 408e08e78b1883eba73e6554b1890f1a: 2023-07-17 02:12:36,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:36,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 83fd289cd7b3b33d20bb3bfa1e86b9e4, disabling compactions & flushes 2023-07-17 02:12:36,632 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:36,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:36,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. after waiting 0 ms 2023-07-17 02:12:36,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:36,632 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:36,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 83fd289cd7b3b33d20bb3bfa1e86b9e4: 2023-07-17 02:12:36,637 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 02:12:36,638 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559956638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559956638"}]},"ts":"1689559956638"} 2023-07-17 02:12:36,638 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559956638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559956638"}]},"ts":"1689559956638"} 2023-07-17 02:12:36,647 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 02:12:36,648 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 02:12:36,648 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559956648"}]},"ts":"1689559956648"} 2023-07-17 02:12:36,650 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-17 02:12:36,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 02:12:36,653 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:12:36,655 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:12:36,655 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:12:36,655 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:12:36,655 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:12:36,655 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=408e08e78b1883eba73e6554b1890f1a, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83fd289cd7b3b33d20bb3bfa1e86b9e4, ASSIGN}] 2023-07-17 02:12:36,659 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83fd289cd7b3b33d20bb3bfa1e86b9e4, ASSIGN 2023-07-17 02:12:36,660 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=408e08e78b1883eba73e6554b1890f1a, ASSIGN 2023-07-17 02:12:36,674 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=408e08e78b1883eba73e6554b1890f1a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35673,1689559874442; forceNewPlan=false, retain=false 2023-07-17 02:12:36,674 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83fd289cd7b3b33d20bb3bfa1e86b9e4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37335,1689559874362; forceNewPlan=false, retain=false 2023-07-17 02:12:36,824 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 02:12:36,827 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=83fd289cd7b3b33d20bb3bfa1e86b9e4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:36,828 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559956827"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559956827"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559956827"}]},"ts":"1689559956827"} 2023-07-17 02:12:36,828 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=408e08e78b1883eba73e6554b1890f1a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:36,828 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559956828"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559956828"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559956828"}]},"ts":"1689559956828"} 2023-07-17 02:12:36,830 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 83fd289cd7b3b33d20bb3bfa1e86b9e4, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:12:36,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 408e08e78b1883eba73e6554b1890f1a, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:12:36,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 02:12:36,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:36,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 408e08e78b1883eba73e6554b1890f1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 02:12:36,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. service=AccessControlService 2023-07-17 02:12:36,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:12:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:12:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:12:36,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:12:37,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:37,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83fd289cd7b3b33d20bb3bfa1e86b9e4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 02:12:37,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. service=AccessControlService 2023-07-17 02:12:37,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:12:37,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:12:37,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:37,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:12:37,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:12:37,015 INFO [StoreOpener-408e08e78b1883eba73e6554b1890f1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:12:37,019 INFO [StoreOpener-83fd289cd7b3b33d20bb3bfa1e86b9e4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:12:37,024 DEBUG [StoreOpener-83fd289cd7b3b33d20bb3bfa1e86b9e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/cf 2023-07-17 02:12:37,024 DEBUG [StoreOpener-83fd289cd7b3b33d20bb3bfa1e86b9e4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/cf 2023-07-17 02:12:37,025 DEBUG [StoreOpener-408e08e78b1883eba73e6554b1890f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/cf 2023-07-17 02:12:37,025 DEBUG [StoreOpener-408e08e78b1883eba73e6554b1890f1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/cf 2023-07-17 02:12:37,026 INFO [StoreOpener-83fd289cd7b3b33d20bb3bfa1e86b9e4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83fd289cd7b3b33d20bb3bfa1e86b9e4 columnFamilyName cf 2023-07-17 02:12:37,026 INFO [StoreOpener-408e08e78b1883eba73e6554b1890f1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 408e08e78b1883eba73e6554b1890f1a columnFamilyName cf 2023-07-17 02:12:37,032 INFO [StoreOpener-83fd289cd7b3b33d20bb3bfa1e86b9e4-1] regionserver.HStore(310): Store=83fd289cd7b3b33d20bb3bfa1e86b9e4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:12:37,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:12:37,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:12:37,035 INFO [StoreOpener-408e08e78b1883eba73e6554b1890f1a-1] regionserver.HStore(310): Store=408e08e78b1883eba73e6554b1890f1a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:12:37,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:12:37,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:12:37,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:12:37,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:12:37,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83fd289cd7b3b33d20bb3bfa1e86b9e4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61816918, jitterRate=-0.07885614037513733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:12:37,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83fd289cd7b3b33d20bb3bfa1e86b9e4: 2023-07-17 02:12:37,046 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4., pid=60, masterSystemTime=1689559956994 2023-07-17 02:12:37,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:37,048 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:37,049 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=83fd289cd7b3b33d20bb3bfa1e86b9e4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,049 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559957049"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559957049"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559957049"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559957049"}]},"ts":"1689559957049"} 2023-07-17 02:12:37,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:12:37,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-17 02:12:37,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 83fd289cd7b3b33d20bb3bfa1e86b9e4, server=jenkins-hbase4.apache.org,37335,1689559874362 in 221 msec 2023-07-17 02:12:37,055 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:12:37,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 408e08e78b1883eba73e6554b1890f1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70595141, jitterRate=0.051949575543403625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:12:37,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 408e08e78b1883eba73e6554b1890f1a: 2023-07-17 02:12:37,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a., pid=61, masterSystemTime=1689559956994 2023-07-17 02:12:37,062 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83fd289cd7b3b33d20bb3bfa1e86b9e4, ASSIGN in 399 msec 2023-07-17 02:12:37,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:37,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:37,063 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=408e08e78b1883eba73e6554b1890f1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,064 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559957063"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559957063"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559957063"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559957063"}]},"ts":"1689559957063"} 2023-07-17 02:12:37,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-17 02:12:37,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 408e08e78b1883eba73e6554b1890f1a, server=jenkins-hbase4.apache.org,35673,1689559874442 in 237 msec 2023-07-17 02:12:37,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-17 02:12:37,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=408e08e78b1883eba73e6554b1890f1a, ASSIGN in 427 msec 2023-07-17 02:12:37,085 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 02:12:37,086 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559957085"}]},"ts":"1689559957085"} 2023-07-17 02:12:37,087 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-17 02:12:37,094 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 02:12:37,094 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-17 02:12:37,104 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 02:12:37,107 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:37,107 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:37,107 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:37,107 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:37,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 575 msec 2023-07-17 02:12:37,123 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:37,123 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:37,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:37,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:37,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 02:12:37,154 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-17 02:12:37,155 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-17 02:12:37,155 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:12:37,161 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-17 02:12:37,162 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:12:37,162 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-17 02:12:37,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 02:12:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559957165 (current time:1689559957165). 2023-07-17 02:12:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:12:37,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x4adb84c2 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:37,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b750151, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:37,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:37,193 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:37,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4adb84c2 to 127.0.0.1:62514 2023-07-17 02:12:37,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:37,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x1478d7ee to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:37,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@293bc37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:37,223 DEBUG [hconnection-0x11ff4abd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:37,224 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:37,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:37,237 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:37,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1478d7ee to 127.0.0.1:62514 2023-07-17 02:12:37,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:37,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 02:12:37,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:12:37,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 02:12:37,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 02:12:37,251 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 02:12:37,253 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689560557252 2023-07-17 02:12:37,253 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 02:12:37,255 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:12:37,255 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:12:37,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 02:12:37,260 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 02:12:37,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 11 msec 2023-07-17 02:12:37,268 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 02:12:37,270 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689560557270 2023-07-17 02:12:37,355 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:37,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 02:12:37,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:12:37,357 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:12:37,557 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:37,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 02:12:37,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:12:37,559 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 02:12:37,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,698 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 02:12:37,698 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:37,698 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 02:12:37,698 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 02:12:37,698 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,699 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:37,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:37,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:37,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:37,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:37,700 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:37,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:37,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:37,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:37,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,700 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,701 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,701 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,701 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:12:37,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 02:12:37,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 02:12:37,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,702 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 02:12:37,702 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 02:12:37,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,702 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 02:12:37,702 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:37,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,704 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 02:12:37,704 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 02:12:37,704 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:37,704 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 02:12:37,705 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 02:12:37,705 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 02:12:37,705 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 02:12:37,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 02:12:37,705 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 02:12:37,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,705 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 02:12:37,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,706 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 02:12:37,707 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:37,708 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,708 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:37,708 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,708 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,708 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:37,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:37,708 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 02:12:37,708 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 02:12:37,708 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 02:12:37,714 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,714 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:37,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:37,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,717 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,717 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,717 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,717 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:37,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:37,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 02:12:37,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21487f3a[Count = 1] remaining members to acquire global barrier 2023-07-17 02:12:37,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:37,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:37,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:37,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:37,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:37,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 02:12:37,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21487f3a[Count = 0] remaining members to acquire global barrier 2023-07-17 02:12:37,722 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 02:12:37,722 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,723 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,723 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,723 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,724 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 02:12:37,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,724 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,724 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:12:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 02:12:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 02:12:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:12:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 02:12:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:12:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:12:37,724 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:37,724 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:12:37,725 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:12:37,725 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. started... 2023-07-17 02:12:37,725 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:37,725 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. started... 2023-07-17 02:12:37,726 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83fd289cd7b3b33d20bb3bfa1e86b9e4: 2023-07-17 02:12:37,727 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 408e08e78b1883eba73e6554b1890f1a: 2023-07-17 02:12:37,727 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,727 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:12:37,727 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,727 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:12:37,728 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:12:37,728 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:12:37,736 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 02:12:37,736 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:37,736 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 02:12:37,761 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. completed. 2023-07-17 02:12:37,761 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:37,761 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:12:37,761 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:12:37,761 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,761 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 02:12:37,761 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:12:37,765 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. completed. 2023-07-17 02:12:37,765 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:37,766 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:12:37,766 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:12:37,766 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,766 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 02:12:37,766 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:12:37,766 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 02:12:37,766 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,766 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:37,767 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 02:12:37,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:37,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:37,768 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,768 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 02:12:37,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:37,769 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:37,769 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 02:12:37,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:37,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:37,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:12:37,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 02:12:37,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:37,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:37,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:37,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:37,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:12:37,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 02:12:37,777 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 02:12:37,777 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:12:37,777 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:12:37,777 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,777 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:12:37,778 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,779 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,778 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,778 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,779 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:37,779 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:37,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,779 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:37,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,779 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:37,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:37,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:37,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:37,780 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,781 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:37,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:37,783 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,783 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,783 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,786 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,786 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:37,786 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,786 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:37,787 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:37,786 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:37,787 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:37,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:37,787 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,787 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:37,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:37,787 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:37,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:37,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:37,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:37,788 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:37,788 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,789 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:37,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:37,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:37,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:37,789 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,789 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,789 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,789 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,789 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:37,789 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:37,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 02:12:37,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,855 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689559957253Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689559957788 (+535 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689559957789 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689559957792 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689559957807 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689559957854 (+47 ms) 2023-07-17 02:12:37,858 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 02:12:37,859 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:37,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 604 msec 2023-07-17 02:12:37,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 02:12:37,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:12:37,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37335] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:12:37,879 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35673] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:12:37,882 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,882 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:37,884 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:12:37,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 02:12:37,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559957894 (current time:1689559957894). 2023-07-17 02:12:37,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:12:37,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x5ba246b2 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:37,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c3aee53, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:37,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:37,913 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:37,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ba246b2 to 127.0.0.1:62514 2023-07-17 02:12:37,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:37,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x08bd75a3 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:37,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@416325d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:37,929 DEBUG [hconnection-0x6a8003d9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:37,932 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:37,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:37,939 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:37,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08bd75a3 to 127.0.0.1:62514 2023-07-17 02:12:37,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:37,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 02:12:37,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:12:37,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 02:12:37,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 02:12:37,946 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 02:12:37,947 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689560557947 2023-07-17 02:12:37,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 02:12:37,947 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,948 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:12:37,948 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:12:37,950 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 02:12:37,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 02:12:37,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-17 02:12:37,952 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 02:12:37,953 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689560557953 2023-07-17 02:12:37,965 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,965 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 02:12:37,965 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:37,967 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 02:12:37,967 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 02:12:37,968 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,968 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,970 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:37,970 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:37,970 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:37,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:37,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:37,970 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:37,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:37,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:37,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:37,971 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,971 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,971 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,971 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:12:37,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,973 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 02:12:37,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 02:12:37,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 02:12:37,973 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:37,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,974 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 02:12:37,975 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 02:12:37,975 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:37,974 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 02:12:37,976 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 02:12:37,976 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 02:12:37,975 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:37,976 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 02:12:37,976 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 02:12:37,977 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 02:12:37,977 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 02:12:37,977 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 02:12:37,977 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 02:12:37,978 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,978 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:37,979 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,979 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,979 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:37,979 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,979 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:37,979 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,979 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:37,979 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,979 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:37,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:37,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:37,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 02:12:37,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cdcc03f[Count = 1] remaining members to acquire global barrier 2023-07-17 02:12:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:37,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 02:12:37,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cdcc03f[Count = 0] remaining members to acquire global barrier 2023-07-17 02:12:37,986 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 02:12:37,986 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,987 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,987 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,987 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 02:12:37,988 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 02:12:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:12:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:12:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 02:12:37,988 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 02:12:37,988 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. started... 2023-07-17 02:12:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:12:37,988 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:37,988 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:12:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:12:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:12:37,988 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:37,988 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. started... 2023-07-17 02:12:37,988 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 83fd289cd7b3b33d20bb3bfa1e86b9e4 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-17 02:12:37,989 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 408e08e78b1883eba73e6554b1890f1a 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-17 02:12:37,990 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 02:12:37,990 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:37,990 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 02:12:38,049 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:38,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 02:12:38,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:12:38,051 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:12:38,052 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/.tmp/cf/c7fc2850914b4b73ad0b2810261d0ec1 2023-07-17 02:12:38,068 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/.tmp/cf/c7fc2850914b4b73ad0b2810261d0ec1 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/cf/c7fc2850914b4b73ad0b2810261d0ec1 2023-07-17 02:12:38,075 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/cf/c7fc2850914b4b73ad0b2810261d0ec1, entries=6, sequenceid=6, filesize=5.2 K 2023-07-17 02:12:38,076 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 408e08e78b1883eba73e6554b1890f1a in 88ms, sequenceid=6, compaction requested=false 2023-07-17 02:12:38,077 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-17 02:12:38,077 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 408e08e78b1883eba73e6554b1890f1a: 2023-07-17 02:12:38,078 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,078 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:12:38,078 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/cf/c7fc2850914b4b73ad0b2810261d0ec1] hfiles 2023-07-17 02:12:38,078 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/cf/c7fc2850914b4b73ad0b2810261d0ec1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,092 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. completed. 2023-07-17 02:12:38,092 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:12:38,092 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:12:38,092 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:12:38,092 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,092 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 02:12:38,092 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:12:38,094 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 02:12:38,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:38,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:38,094 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 02:12:38,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:12:38,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 02:12:38,251 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:38,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 02:12:38,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:12:38,253 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 02:12:38,460 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/.tmp/cf/c8414cd3d6544ae2a96f06d133a67eb2 2023-07-17 02:12:38,468 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/.tmp/cf/c8414cd3d6544ae2a96f06d133a67eb2 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/cf/c8414cd3d6544ae2a96f06d133a67eb2 2023-07-17 02:12:38,473 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/cf/c8414cd3d6544ae2a96f06d133a67eb2, entries=44, sequenceid=6, filesize=7.8 K 2023-07-17 02:12:38,474 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 83fd289cd7b3b33d20bb3bfa1e86b9e4 in 486ms, sequenceid=6, compaction requested=false 2023-07-17 02:12:38,476 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83fd289cd7b3b33d20bb3bfa1e86b9e4: 2023-07-17 02:12:38,476 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,477 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:12:38,477 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/cf/c8414cd3d6544ae2a96f06d133a67eb2] hfiles 2023-07-17 02:12:38,477 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/cf/c8414cd3d6544ae2a96f06d133a67eb2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,483 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. completed. 2023-07-17 02:12:38,484 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:12:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:12:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:12:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 02:12:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:12:38,486 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,486 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 02:12:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:38,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:38,486 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:38,486 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 02:12:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:38,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:12:38,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 02:12:38,490 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 02:12:38,490 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:12:38,490 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:12:38,490 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,490 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:12:38,496 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:38,496 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:38,496 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:38,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:38,496 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:38,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:38,497 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,497 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:38,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,499 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:38,499 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,499 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,502 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,502 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:38,502 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:38,502 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:38,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:38,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:38,503 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:38,503 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,502 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:38,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,502 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:38,503 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:38,503 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,503 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:38,503 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:38,503 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:38,505 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:38,505 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:38,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:38,505 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:38,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:38,505 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:38,505 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,505 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,554 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:38,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 02:12:38,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:12:38,555 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 02:12:38,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 02:12:38,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,954 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:12:38,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689559957947Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689559958503 (+556 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689559958503Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689559958508 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689559958515 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689559958953 (+438 ms) 2023-07-17 02:12:38,957 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 02:12:38,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.0090 sec 2023-07-17 02:12:39,055 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:39,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 02:12:39,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:12:39,085 DEBUG [Listener at jenkins-hbase4.apache.org/46125] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 02:12:39,088 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 02:12:39,090 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35673] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 02:12:39,090 DEBUG [Listener at jenkins-hbase4.apache.org/46125] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 02:12:39,094 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 02:12:39,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37335] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 02:12:39,095 DEBUG [Listener at jenkins-hbase4.apache.org/46125] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 02:12:39,097 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 02:12:39,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45215] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 02:12:39,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 02:12:39,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:39,107 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 02:12:39,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-17 02:12:39,107 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 02:12:39,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 02:12:39,110 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,110 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,111 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d empty. 2023-07-17 02:12:39,111 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550 empty. 2023-07-17 02:12:39,111 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,111 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,111 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 02:12:39,122 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-17 02:12:39,123 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => b31dbf87b5d98b634155a9fb060a9e5d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:12:39,127 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => cda61cda7a970de7856127e0a648e550, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:12:39,144 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:39,144 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing b31dbf87b5d98b634155a9fb060a9e5d, disabling compactions & flushes 2023-07-17 02:12:39,144 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,144 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,144 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. after waiting 0 ms 2023-07-17 02:12:39,144 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,144 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,144 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for b31dbf87b5d98b634155a9fb060a9e5d: 2023-07-17 02:12:39,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:39,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing cda61cda7a970de7856127e0a648e550, disabling compactions & flushes 2023-07-17 02:12:39,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. after waiting 0 ms 2023-07-17 02:12:39,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,146 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,146 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for cda61cda7a970de7856127e0a648e550: 2023-07-17 02:12:39,149 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 02:12:39,150 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559959150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559959150"}]},"ts":"1689559959150"} 2023-07-17 02:12:39,150 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559959150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559959150"}]},"ts":"1689559959150"} 2023-07-17 02:12:39,152 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 02:12:39,153 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 02:12:39,153 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559959153"}]},"ts":"1689559959153"} 2023-07-17 02:12:39,154 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-17 02:12:39,158 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:12:39,159 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:12:39,159 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:12:39,159 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:12:39,159 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:12:39,159 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b31dbf87b5d98b634155a9fb060a9e5d, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cda61cda7a970de7856127e0a648e550, ASSIGN}] 2023-07-17 02:12:39,162 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cda61cda7a970de7856127e0a648e550, ASSIGN 2023-07-17 02:12:39,162 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b31dbf87b5d98b634155a9fb060a9e5d, ASSIGN 2023-07-17 02:12:39,163 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b31dbf87b5d98b634155a9fb060a9e5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45215,1689559874524; forceNewPlan=false, retain=false 2023-07-17 02:12:39,163 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cda61cda7a970de7856127e0a648e550, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35673,1689559874442; forceNewPlan=false, retain=false 2023-07-17 02:12:39,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 02:12:39,313 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 02:12:39,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=cda61cda7a970de7856127e0a648e550, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:39,316 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b31dbf87b5d98b634155a9fb060a9e5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:39,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559959316"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559959316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559959316"}]},"ts":"1689559959316"} 2023-07-17 02:12:39,316 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559959316"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559959316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559959316"}]},"ts":"1689559959316"} 2023-07-17 02:12:39,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure cda61cda7a970de7856127e0a648e550, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:12:39,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure b31dbf87b5d98b634155a9fb060a9e5d, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:12:39,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 02:12:39,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b31dbf87b5d98b634155a9fb060a9e5d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.', STARTKEY => '', ENDKEY => '2'} 2023-07-17 02:12:39,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cda61cda7a970de7856127e0a648e550, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.', STARTKEY => '2', ENDKEY => ''} 2023-07-17 02:12:39,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. service=AccessControlService 2023-07-17 02:12:39,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. service=AccessControlService 2023-07-17 02:12:39,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:12:39,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:12:39,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:39,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:39,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,477 INFO [StoreOpener-cda61cda7a970de7856127e0a648e550-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,479 INFO [StoreOpener-b31dbf87b5d98b634155a9fb060a9e5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,480 DEBUG [StoreOpener-cda61cda7a970de7856127e0a648e550-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/cf 2023-07-17 02:12:39,480 DEBUG [StoreOpener-cda61cda7a970de7856127e0a648e550-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/cf 2023-07-17 02:12:39,480 DEBUG [StoreOpener-b31dbf87b5d98b634155a9fb060a9e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/cf 2023-07-17 02:12:39,480 DEBUG [StoreOpener-b31dbf87b5d98b634155a9fb060a9e5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/cf 2023-07-17 02:12:39,480 INFO [StoreOpener-cda61cda7a970de7856127e0a648e550-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cda61cda7a970de7856127e0a648e550 columnFamilyName cf 2023-07-17 02:12:39,480 INFO [StoreOpener-b31dbf87b5d98b634155a9fb060a9e5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b31dbf87b5d98b634155a9fb060a9e5d columnFamilyName cf 2023-07-17 02:12:39,481 INFO [StoreOpener-cda61cda7a970de7856127e0a648e550-1] regionserver.HStore(310): Store=cda61cda7a970de7856127e0a648e550/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:12:39,481 INFO [StoreOpener-b31dbf87b5d98b634155a9fb060a9e5d-1] regionserver.HStore(310): Store=b31dbf87b5d98b634155a9fb060a9e5d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:12:39,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:12:39,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:12:39,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b31dbf87b5d98b634155a9fb060a9e5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75053886, jitterRate=0.1183900535106659}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:12:39,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cda61cda7a970de7856127e0a648e550; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74531085, jitterRate=0.11059971153736115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:12:39,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b31dbf87b5d98b634155a9fb060a9e5d: 2023-07-17 02:12:39,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cda61cda7a970de7856127e0a648e550: 2023-07-17 02:12:39,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550., pid=69, masterSystemTime=1689559959470 2023-07-17 02:12:39,492 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d., pid=70, masterSystemTime=1689559959470 2023-07-17 02:12:39,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,495 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=cda61cda7a970de7856127e0a648e550, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:39,495 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559959495"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559959495"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559959495"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559959495"}]},"ts":"1689559959495"} 2023-07-17 02:12:39,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,496 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b31dbf87b5d98b634155a9fb060a9e5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:39,496 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559959496"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559959496"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559959496"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559959496"}]},"ts":"1689559959496"} 2023-07-17 02:12:39,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-17 02:12:39,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure cda61cda7a970de7856127e0a648e550, server=jenkins-hbase4.apache.org,35673,1689559874442 in 179 msec 2023-07-17 02:12:39,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-17 02:12:39,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure b31dbf87b5d98b634155a9fb060a9e5d, server=jenkins-hbase4.apache.org,45215,1689559874524 in 179 msec 2023-07-17 02:12:39,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cda61cda7a970de7856127e0a648e550, ASSIGN in 353 msec 2023-07-17 02:12:39,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-17 02:12:39,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b31dbf87b5d98b634155a9fb060a9e5d, ASSIGN in 354 msec 2023-07-17 02:12:39,516 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 02:12:39,517 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559959516"}]},"ts":"1689559959516"} 2023-07-17 02:12:39,518 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-17 02:12:39,521 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 02:12:39,521 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-17 02:12:39,523 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 02:12:39,525 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:39,525 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:39,525 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:39,525 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:12:39,526 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:39,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:39,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:39,528 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:39,528 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:39,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:39,528 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:39,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:39,528 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:39,529 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:39,529 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 02:12:39,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 429 msec 2023-07-17 02:12:39,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 02:12:39,713 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-17 02:12:39,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions b31dbf87b5d98b634155a9fb060a9e5d, cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b31dbf87b5d98b634155a9fb060a9e5d, cda61cda7a970de7856127e0a648e550], force=true 2023-07-17 02:12:39,761 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b31dbf87b5d98b634155a9fb060a9e5d, cda61cda7a970de7856127e0a648e550], force=true 2023-07-17 02:12:39,761 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b31dbf87b5d98b634155a9fb060a9e5d, cda61cda7a970de7856127e0a648e550], force=true 2023-07-17 02:12:39,761 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b31dbf87b5d98b634155a9fb060a9e5d, cda61cda7a970de7856127e0a648e550], force=true 2023-07-17 02:12:39,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 02:12:39,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b31dbf87b5d98b634155a9fb060a9e5d, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cda61cda7a970de7856127e0a648e550, UNASSIGN}] 2023-07-17 02:12:39,799 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b31dbf87b5d98b634155a9fb060a9e5d, UNASSIGN 2023-07-17 02:12:39,801 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cda61cda7a970de7856127e0a648e550, UNASSIGN 2023-07-17 02:12:39,801 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b31dbf87b5d98b634155a9fb060a9e5d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:39,801 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559959801"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559959801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559959801"}]},"ts":"1689559959801"} 2023-07-17 02:12:39,802 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=cda61cda7a970de7856127e0a648e550, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:39,802 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559959802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559959802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559959802"}]},"ts":"1689559959802"} 2023-07-17 02:12:39,803 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure b31dbf87b5d98b634155a9fb060a9e5d, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:12:39,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure cda61cda7a970de7856127e0a648e550, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:12:39,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 02:12:39,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:39,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b31dbf87b5d98b634155a9fb060a9e5d, disabling compactions & flushes 2023-07-17 02:12:39,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. after waiting 0 ms 2023-07-17 02:12:39,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:39,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b31dbf87b5d98b634155a9fb060a9e5d 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 02:12:39,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:39,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cda61cda7a970de7856127e0a648e550, disabling compactions & flushes 2023-07-17 02:12:39,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. after waiting 0 ms 2023-07-17 02:12:39,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:39,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cda61cda7a970de7856127e0a648e550 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 02:12:39,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/.tmp/cf/be484fc44a99484788a18f5203f4c24d 2023-07-17 02:12:39,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/.tmp/cf/9ab178f3bdd147fd98904b88f34fab07 2023-07-17 02:12:40,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/.tmp/cf/be484fc44a99484788a18f5203f4c24d as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/cf/be484fc44a99484788a18f5203f4c24d 2023-07-17 02:12:40,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/.tmp/cf/9ab178f3bdd147fd98904b88f34fab07 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/cf/9ab178f3bdd147fd98904b88f34fab07 2023-07-17 02:12:40,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/cf/be484fc44a99484788a18f5203f4c24d, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 02:12:40,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for cda61cda7a970de7856127e0a648e550 in 47ms, sequenceid=5, compaction requested=false 2023-07-17 02:12:40,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 02:12:40,008 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/cf/9ab178f3bdd147fd98904b88f34fab07, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 02:12:40,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b31dbf87b5d98b634155a9fb060a9e5d in 52ms, sequenceid=5, compaction requested=false 2023-07-17 02:12:40,019 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 02:12:40,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:12:40,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550. 2023-07-17 02:12:40,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cda61cda7a970de7856127e0a648e550: 2023-07-17 02:12:40,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 02:12:40,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:12:40,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d. 2023-07-17 02:12:40,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b31dbf87b5d98b634155a9fb060a9e5d: 2023-07-17 02:12:40,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cda61cda7a970de7856127e0a648e550 2023-07-17 02:12:40,025 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=cda61cda7a970de7856127e0a648e550, regionState=CLOSED 2023-07-17 02:12:40,025 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559960025"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559960025"}]},"ts":"1689559960025"} 2023-07-17 02:12:40,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:12:40,026 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b31dbf87b5d98b634155a9fb060a9e5d, regionState=CLOSED 2023-07-17 02:12:40,026 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689559960026"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559960026"}]},"ts":"1689559960026"} 2023-07-17 02:12:40,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-17 02:12:40,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure cda61cda7a970de7856127e0a648e550, server=jenkins-hbase4.apache.org,35673,1689559874442 in 223 msec 2023-07-17 02:12:40,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-17 02:12:40,031 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure b31dbf87b5d98b634155a9fb060a9e5d, server=jenkins-hbase4.apache.org,45215,1689559874524 in 225 msec 2023-07-17 02:12:40,031 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cda61cda7a970de7856127e0a648e550, UNASSIGN in 231 msec 2023-07-17 02:12:40,033 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-17 02:12:40,033 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b31dbf87b5d98b634155a9fb060a9e5d, UNASSIGN in 247 msec 2023-07-17 02:12:40,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 02:12:40,105 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-17 02:12:40,107 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959100.b31dbf87b5d98b634155a9fb060a9e5d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 02:12:40,107 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689559959100.cda61cda7a970de7856127e0a648e550.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 02:12:40,108 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 02:12:40,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2afbc61f0cad291229cac8fa5578667d, ASSIGN}] 2023-07-17 02:12:40,164 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2afbc61f0cad291229cac8fa5578667d, ASSIGN 2023-07-17 02:12:40,165 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2afbc61f0cad291229cac8fa5578667d, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45215,1689559874524; forceNewPlan=false, retain=false 2023-07-17 02:12:40,315 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 02:12:40,317 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2afbc61f0cad291229cac8fa5578667d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:40,317 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689559960317"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559960317"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559960317"}]},"ts":"1689559960317"} 2023-07-17 02:12:40,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 2afbc61f0cad291229cac8fa5578667d, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:12:40,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 02:12:40,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. 2023-07-17 02:12:40,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2afbc61f0cad291229cac8fa5578667d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.', STARTKEY => '', ENDKEY => ''} 2023-07-17 02:12:40,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. service=AccessControlService 2023-07-17 02:12:40,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:12:40,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:12:40,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:12:40,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:12:40,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:12:40,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/.regioninfo 2023-07-17 02:12:40,499 INFO [StoreOpener-2afbc61f0cad291229cac8fa5578667d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:12:40,500 DEBUG [StoreOpener-2afbc61f0cad291229cac8fa5578667d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf 2023-07-17 02:12:40,500 DEBUG [StoreOpener-2afbc61f0cad291229cac8fa5578667d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf 2023-07-17 02:12:40,502 INFO [StoreOpener-2afbc61f0cad291229cac8fa5578667d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2afbc61f0cad291229cac8fa5578667d columnFamilyName cf 2023-07-17 02:12:40,548 DEBUG [StoreOpener-2afbc61f0cad291229cac8fa5578667d-1] regionserver.HStore(539): loaded hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/9ab178f3bdd147fd98904b88f34fab07.b31dbf87b5d98b634155a9fb060a9e5d->hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/cf/9ab178f3bdd147fd98904b88f34fab07-top 2023-07-17 02:12:40,556 DEBUG [StoreOpener-2afbc61f0cad291229cac8fa5578667d-1] regionserver.HStore(539): loaded hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/be484fc44a99484788a18f5203f4c24d.cda61cda7a970de7856127e0a648e550->hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/cf/be484fc44a99484788a18f5203f4c24d-top 2023-07-17 02:12:40,557 INFO [StoreOpener-2afbc61f0cad291229cac8fa5578667d-1] regionserver.HStore(310): Store=2afbc61f0cad291229cac8fa5578667d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:12:40,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:12:40,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:12:40,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:12:40,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2afbc61f0cad291229cac8fa5578667d; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71215087, jitterRate=0.061187490820884705}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:12:40,565 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2afbc61f0cad291229cac8fa5578667d: 2023-07-17 02:12:40,565 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d., pid=77, masterSystemTime=1689559960471 2023-07-17 02:12:40,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.,because compaction is disabled. 2023-07-17 02:12:40,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. 2023-07-17 02:12:40,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. 2023-07-17 02:12:40,568 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2afbc61f0cad291229cac8fa5578667d, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:40,568 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689559960568"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559960568"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559960568"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559960568"}]},"ts":"1689559960568"} 2023-07-17 02:12:40,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-17 02:12:40,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 2afbc61f0cad291229cac8fa5578667d, server=jenkins-hbase4.apache.org,45215,1689559874524 in 253 msec 2023-07-17 02:12:40,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-17 02:12:40,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2afbc61f0cad291229cac8fa5578667d, ASSIGN in 411 msec 2023-07-17 02:12:40,582 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0004_000001 (auth:SIMPLE) 2023-07-17 02:12:40,586 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b31dbf87b5d98b634155a9fb060a9e5d, cda61cda7a970de7856127e0a648e550], force=true in 834 msec 2023-07-17 02:12:40,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 02:12:40,876 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-17 02:12:40,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 02:12:40,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559960878 (current time:1689559960878). 2023-07-17 02:12:40,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:12:40,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x0e0acbac to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:40,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8940bca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:40,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:40,897 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:40,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e0acbac to 127.0.0.1:62514 2023-07-17 02:12:40,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:40,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x56f4c71d to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:12:40,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e7b31c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:12:40,911 DEBUG [hconnection-0x2699b19a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:40,915 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:40,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:12:40,923 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:12:40,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56f4c71d to 127.0.0.1:62514 2023-07-17 02:12:40,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:12:40,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 02:12:40,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:12:40,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 02:12:40,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 02:12:40,929 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 02:12:40,931 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689560560931 2023-07-17 02:12:40,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 02:12:40,931 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,935 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:12:40,935 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:12:40,936 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 02:12:40,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 02:12:40,937 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-17 02:12:40,938 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 02:12:40,939 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689560560939 2023-07-17 02:12:40,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,979 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 02:12:40,979 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:40,980 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-17 02:12:40,980 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-17 02:12:40,981 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,981 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,982 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:40,982 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:40,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:40,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:40,982 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:40,982 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:40,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:40,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:40,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:40,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,982 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:40,983 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:12:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 02:12:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,984 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 02:12:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 02:12:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 02:12:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,984 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 02:12:40,984 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 02:12:40,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,987 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 02:12:40,987 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:40,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,987 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 02:12:40,987 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 02:12:40,987 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:40,987 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:12:40,990 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 02:12:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 02:12:40,989 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 02:12:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 02:12:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 02:12:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 02:12:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 02:12:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 02:12:40,992 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 02:12:40,996 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,996 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:40,996 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:40,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:40,996 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,999 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,999 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:40,999 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,999 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:40,999 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:40,999 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:12:41,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:41,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-17 02:12:41,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@201cde86[Count = 0] remaining members to acquire global barrier 2023-07-17 02:12:41,003 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-17 02:12:41,003 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,005 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,005 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,005 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 02:12:41,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,005 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,005 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:12:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:12:41,006 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:12:41,006 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. 2023-07-17 02:12:41,005 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 02:12:41,006 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 02:12:41,006 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. started... 2023-07-17 02:12:41,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,006 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:12:41,008 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 02:12:41,008 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 02:12:41,008 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:12:41,009 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2afbc61f0cad291229cac8fa5578667d: 2023-07-17 02:12:41,009 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,010 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:12:41,010 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/9ab178f3bdd147fd98904b88f34fab07.b31dbf87b5d98b634155a9fb060a9e5d->hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/cf/9ab178f3bdd147fd98904b88f34fab07-top, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/be484fc44a99484788a18f5203f4c24d.cda61cda7a970de7856127e0a648e550->hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/cf/be484fc44a99484788a18f5203f4c24d-top] hfiles 2023-07-17 02:12:41,010 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/9ab178f3bdd147fd98904b88f34fab07.b31dbf87b5d98b634155a9fb060a9e5d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,011 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/be484fc44a99484788a18f5203f4c24d.cda61cda7a970de7856127e0a648e550 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,011 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 02:12:41,011 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 02:12:41,011 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:41,011 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 02:12:41,011 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:41,011 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 02:12:41,035 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. completed. 2023-07-17 02:12:41,035 DEBUG [rs(jenkins-hbase4.apache.org,45215,1689559874524)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. 2023-07-17 02:12:41,035 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:41,035 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:12:41,036 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:12:41,036 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,036 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 02:12:41,036 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:12:41,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 02:12:41,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:12:41,037 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:12:41,041 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 02:12:41,041 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,041 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:41,041 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 02:12:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:41,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:41,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:41,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:41,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:41,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:41,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45215,1689559874524': 2023-07-17 02:12:41,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-17 02:12:41,061 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-17 02:12:41,062 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:12:41,062 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:12:41,062 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,062 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:12:41,065 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:41,065 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:41,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:12:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:12:41,065 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:12:41,065 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:41,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:41,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:41,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:41,066 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,067 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:41,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:12:41,068 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:41,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:12:41,071 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:41,072 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:41,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,077 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:41,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:41,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,088 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:41,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:41,088 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:41,088 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,089 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,089 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:12:41,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:41,088 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:41,088 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:12:41,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:41,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:12:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:41,089 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:41,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,089 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:41,089 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,089 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:41,089 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,089 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:12:41,090 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,090 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:12:41,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:12:41,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:41,089 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:12:41,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:41,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:41,090 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:12:41,090 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,090 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:12:41,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:12:41,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,237 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:41,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 02:12:41,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:12:41,239 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 02:12:41,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-17 02:12:41,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,305 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689559960931Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689559961089 (+158 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689559961089Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689559961097 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689559961142 (+45 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689559961304 (+162 ms) 2023-07-17 02:12:41,313 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 02:12:41,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 378 msec 2023-07-17 02:12:41,539 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:12:41,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 02:12:41,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:12:41,542 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542 2023-07-17 02:12:41,543 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39797, tgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542, rawTgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542, srcFsUri=hdfs://localhost:39797, srcDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:12:41,573 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:12:41,574 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-677349221_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,574 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1, snapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-17 02:12:41,586 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:12:41,658 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:41,659 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:41,659 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:41,660 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:41,875 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 02:12:42,769 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-2390339341066757907.jar 2023-07-17 02:12:42,770 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:42,770 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:42,861 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-5913873722952286585.jar 2023-07-17 02:12:42,861 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:42,862 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:42,862 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:42,863 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:42,863 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:42,863 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 02:12:42,864 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 02:12:42,864 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 02:12:42,865 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 02:12:42,865 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 02:12:42,865 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 02:12:42,866 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 02:12:42,866 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 02:12:42,867 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 02:12:42,867 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 02:12:42,868 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 02:12:42,869 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:42,869 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:42,870 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:12:42,870 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:42,871 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:12:42,871 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:12:42,872 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:12:44,210 WARN [Listener at jenkins-hbase4.apache.org/46125] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 02:12:44,213 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-17 02:12:44,215 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-17 02:12:44,341 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:12:44,341 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:12:44,590 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0005_000001 (auth:SIMPLE) 2023-07-17 02:12:50,672 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0005_000001 (auth:SIMPLE) 2023-07-17 02:12:53,092 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0005_000001 (auth:SIMPLE) 2023-07-17 02:12:58,528 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0005_000001 (auth:SIMPLE) 2023-07-17 02:13:00,511 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 02:13:00,515 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 02:13:00,525 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,526 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 02:13:00,526 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 02:13:00,526 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,527 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 02:13:00,527 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 02:13:00,527 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,528 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 02:13:00,528 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559961542/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 02:13:00,536 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 02:13:00,540 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559980540"}]},"ts":"1689559980540"} 2023-07-17 02:13:00,542 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-17 02:13:00,544 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-17 02:13:00,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2afbc61f0cad291229cac8fa5578667d, UNASSIGN}] 2023-07-17 02:13:00,549 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2afbc61f0cad291229cac8fa5578667d, UNASSIGN 2023-07-17 02:13:00,551 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2afbc61f0cad291229cac8fa5578667d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:00,551 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689559980551"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559980551"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559980551"}]},"ts":"1689559980551"} 2023-07-17 02:13:00,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 2afbc61f0cad291229cac8fa5578667d, server=jenkins-hbase4.apache.org,45215,1689559874524}] 2023-07-17 02:13:00,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 02:13:00,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:13:00,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2afbc61f0cad291229cac8fa5578667d, disabling compactions & flushes 2023-07-17 02:13:00,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. 2023-07-17 02:13:00,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. 2023-07-17 02:13:00,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. after waiting 0 ms 2023-07-17 02:13:00,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. 2023-07-17 02:13:00,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-17 02:13:00,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:13:00,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d. 2023-07-17 02:13:00,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2afbc61f0cad291229cac8fa5578667d: 2023-07-17 02:13:00,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:13:00,731 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2afbc61f0cad291229cac8fa5578667d, regionState=CLOSED 2023-07-17 02:13:00,731 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689559980731"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559980731"}]},"ts":"1689559980731"} 2023-07-17 02:13:00,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-17 02:13:00,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 2afbc61f0cad291229cac8fa5578667d, server=jenkins-hbase4.apache.org,45215,1689559874524 in 178 msec 2023-07-17 02:13:00,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-17 02:13:00,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2afbc61f0cad291229cac8fa5578667d, UNASSIGN in 188 msec 2023-07-17 02:13:00,739 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559980739"}]},"ts":"1689559980739"} 2023-07-17 02:13:00,740 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-17 02:13:00,742 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-17 02:13:00,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 206 msec 2023-07-17 02:13:00,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 02:13:00,843 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-17 02:13:00,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,848 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,849 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,851 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,856 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,856 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,856 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,856 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 02:13:00,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 02:13:00,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 02:13:00,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 02:13:00,858 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,858 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:00,858 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,858 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:00,858 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,858 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:00,858 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,858 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:00,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:00,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:00,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:00,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 02:13:00,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:00,860 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:13:00,860 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:13:00,860 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550 2023-07-17 02:13:00,863 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/recovered.edits] 2023-07-17 02:13:00,863 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/recovered.edits] 2023-07-17 02:13:00,864 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/recovered.edits] 2023-07-17 02:13:00,868 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/cf/be484fc44a99484788a18f5203f4c24d to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/cf/be484fc44a99484788a18f5203f4c24d 2023-07-17 02:13:00,869 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/9ab178f3bdd147fd98904b88f34fab07.b31dbf87b5d98b634155a9fb060a9e5d to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/9ab178f3bdd147fd98904b88f34fab07.b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:13:00,869 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/cf/9ab178f3bdd147fd98904b88f34fab07 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/cf/9ab178f3bdd147fd98904b88f34fab07 2023-07-17 02:13:00,871 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/be484fc44a99484788a18f5203f4c24d.cda61cda7a970de7856127e0a648e550 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/cf/be484fc44a99484788a18f5203f4c24d.cda61cda7a970de7856127e0a648e550 2023-07-17 02:13:00,873 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/recovered.edits/8.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550/recovered.edits/8.seqid 2023-07-17 02:13:00,873 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cda61cda7a970de7856127e0a648e550 2023-07-17 02:13:00,874 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/recovered.edits/8.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d/recovered.edits/8.seqid 2023-07-17 02:13:00,875 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b31dbf87b5d98b634155a9fb060a9e5d 2023-07-17 02:13:00,875 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/recovered.edits/12.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d/recovered.edits/12.seqid 2023-07-17 02:13:00,875 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2afbc61f0cad291229cac8fa5578667d 2023-07-17 02:13:00,875 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 02:13:00,878 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,880 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-17 02:13:00,882 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-17 02:13:00,883 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,883 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-17 02:13:00,883 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559980883"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:00,885 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-17 02:13:00,885 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2afbc61f0cad291229cac8fa5578667d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689559959101.2afbc61f0cad291229cac8fa5578667d.', STARTKEY => '', ENDKEY => ''}] 2023-07-17 02:13:00,885 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-17 02:13:00,885 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689559980885"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:00,888 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-17 02:13:00,890 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:00,891 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 46 msec 2023-07-17 02:13:00,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 02:13:00,961 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-17 02:13:00,962 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:00,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:00,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:00,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 02:13:00,969 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559980969"}]},"ts":"1689559980969"} 2023-07-17 02:13:00,971 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-17 02:13:00,973 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-17 02:13:00,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=408e08e78b1883eba73e6554b1890f1a, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83fd289cd7b3b33d20bb3bfa1e86b9e4, UNASSIGN}] 2023-07-17 02:13:00,980 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=408e08e78b1883eba73e6554b1890f1a, UNASSIGN 2023-07-17 02:13:00,980 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83fd289cd7b3b33d20bb3bfa1e86b9e4, UNASSIGN 2023-07-17 02:13:00,982 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=83fd289cd7b3b33d20bb3bfa1e86b9e4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:00,982 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559980982"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559980982"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559980982"}]},"ts":"1689559980982"} 2023-07-17 02:13:00,982 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=408e08e78b1883eba73e6554b1890f1a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:00,983 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559980982"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559980982"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559980982"}]},"ts":"1689559980982"} 2023-07-17 02:13:00,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 83fd289cd7b3b33d20bb3bfa1e86b9e4, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:13:00,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 408e08e78b1883eba73e6554b1890f1a, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:13:01,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 02:13:01,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:13:01,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83fd289cd7b3b33d20bb3bfa1e86b9e4, disabling compactions & flushes 2023-07-17 02:13:01,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:13:01,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:13:01,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. after waiting 0 ms 2023-07-17 02:13:01,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:13:01,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:13:01,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 408e08e78b1883eba73e6554b1890f1a, disabling compactions & flushes 2023-07-17 02:13:01,143 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:13:01,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:13:01,143 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. after waiting 0 ms 2023-07-17 02:13:01,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:13:01,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:13:01,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:13:01,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4. 2023-07-17 02:13:01,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83fd289cd7b3b33d20bb3bfa1e86b9e4: 2023-07-17 02:13:01,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:13:01,168 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=83fd289cd7b3b33d20bb3bfa1e86b9e4, regionState=CLOSED 2023-07-17 02:13:01,168 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559981168"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559981168"}]},"ts":"1689559981168"} 2023-07-17 02:13:01,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:13:01,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:13:01,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a. 2023-07-17 02:13:01,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 408e08e78b1883eba73e6554b1890f1a: 2023-07-17 02:13:01,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:13:01,180 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=408e08e78b1883eba73e6554b1890f1a, regionState=CLOSED 2023-07-17 02:13:01,180 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689559981180"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559981180"}]},"ts":"1689559981180"} 2023-07-17 02:13:01,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-17 02:13:01,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 83fd289cd7b3b33d20bb3bfa1e86b9e4, server=jenkins-hbase4.apache.org,37335,1689559874362 in 196 msec 2023-07-17 02:13:01,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-17 02:13:01,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 408e08e78b1883eba73e6554b1890f1a, server=jenkins-hbase4.apache.org,35673,1689559874442 in 196 msec 2023-07-17 02:13:01,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=83fd289cd7b3b33d20bb3bfa1e86b9e4, UNASSIGN in 211 msec 2023-07-17 02:13:01,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-17 02:13:01,191 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=408e08e78b1883eba73e6554b1890f1a, UNASSIGN in 215 msec 2023-07-17 02:13:01,192 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559981191"}]},"ts":"1689559981191"} 2023-07-17 02:13:01,193 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-17 02:13:01,195 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-17 02:13:01,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 234 msec 2023-07-17 02:13:01,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 02:13:01,270 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-17 02:13:01,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,275 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,276 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,277 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,281 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,281 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,281 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,281 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 02:13:01,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 02:13:01,282 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 02:13:01,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 02:13:01,285 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,285 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:01,285 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,285 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,285 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:01,285 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:01,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 02:13:01,286 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:13:01,286 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:13:01,288 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,288 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:01,296 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/recovered.edits] 2023-07-17 02:13:01,297 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/recovered.edits] 2023-07-17 02:13:01,307 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/cf/c7fc2850914b4b73ad0b2810261d0ec1 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/cf/c7fc2850914b4b73ad0b2810261d0ec1 2023-07-17 02:13:01,307 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/cf/c8414cd3d6544ae2a96f06d133a67eb2 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/cf/c8414cd3d6544ae2a96f06d133a67eb2 2023-07-17 02:13:01,311 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4/recovered.edits/9.seqid 2023-07-17 02:13:01,311 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a/recovered.edits/9.seqid 2023-07-17 02:13:01,312 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/408e08e78b1883eba73e6554b1890f1a 2023-07-17 02:13:01,312 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/83fd289cd7b3b33d20bb3bfa1e86b9e4 2023-07-17 02:13:01,312 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 02:13:01,315 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,317 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-17 02:13:01,322 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-17 02:13:01,323 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,323 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-17 02:13:01,323 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559981323"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:01,324 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559981323"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:01,330 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 02:13:01,330 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 408e08e78b1883eba73e6554b1890f1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689559956545.408e08e78b1883eba73e6554b1890f1a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 83fd289cd7b3b33d20bb3bfa1e86b9e4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689559956545.83fd289cd7b3b33d20bb3bfa1e86b9e4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 02:13:01,330 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-17 02:13:01,330 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689559981330"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:01,332 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-17 02:13:01,334 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 63 msec 2023-07-17 02:13:01,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 02:13:01,388 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-17 02:13:01,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 02:13:01,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 02:13:01,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 02:13:01,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-17 02:13:01,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 02:13:01,471 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 748) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: java.util.concurrent.ThreadPoolExecutor$Worker@11cd6f2[State = -1, empty queue] sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:34182 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:44618 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:56724 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:32925 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:44743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1632791852_1 at /127.0.0.1:46040 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3836 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=509 (was 425) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=2091 (was 2600) 2023-07-17 02:13:01,471 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-17 02:13:01,500 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=509, ProcessCount=181, AvailableMemoryMB=2088 2023-07-17 02:13:01,501 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-17 02:13:01,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 02:13:01,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 02:13:01,507 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 02:13:01,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-17 02:13:01,508 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 02:13:01,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 02:13:01,511 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:01,511 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:01,511 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5 empty. 2023-07-17 02:13:01,512 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6 empty. 2023-07-17 02:13:01,512 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:01,512 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:01,512 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 02:13:01,535 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 02:13:01,537 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 05814321ef5b00f7e6c218b0a192b8a5, NAME => 'testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:13:01,539 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c7699f846450a343cfb6b1e85b3805c6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:13:01,594 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:13:01,594 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c7699f846450a343cfb6b1e85b3805c6, disabling compactions & flushes 2023-07-17 02:13:01,594 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:01,594 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:01,594 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. after waiting 0 ms 2023-07-17 02:13:01,594 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:01,594 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:13:01,594 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:01,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 05814321ef5b00f7e6c218b0a192b8a5, disabling compactions & flushes 2023-07-17 02:13:01,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c7699f846450a343cfb6b1e85b3805c6: 2023-07-17 02:13:01,595 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:01,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:01,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. after waiting 0 ms 2023-07-17 02:13:01,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:01,595 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:01,595 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 05814321ef5b00f7e6c218b0a192b8a5: 2023-07-17 02:13:01,598 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 02:13:01,600 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559981599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559981599"}]},"ts":"1689559981599"} 2023-07-17 02:13:01,600 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559981599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559981599"}]},"ts":"1689559981599"} 2023-07-17 02:13:01,602 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 02:13:01,603 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 02:13:01,603 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559981603"}]},"ts":"1689559981603"} 2023-07-17 02:13:01,604 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 02:13:01,608 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:13:01,609 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:13:01,609 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:13:01,609 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:13:01,609 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:13:01,610 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=05814321ef5b00f7e6c218b0a192b8a5, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7699f846450a343cfb6b1e85b3805c6, ASSIGN}] 2023-07-17 02:13:01,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 02:13:01,612 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7699f846450a343cfb6b1e85b3805c6, ASSIGN 2023-07-17 02:13:01,612 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=05814321ef5b00f7e6c218b0a192b8a5, ASSIGN 2023-07-17 02:13:01,614 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7699f846450a343cfb6b1e85b3805c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35673,1689559874442; forceNewPlan=false, retain=false 2023-07-17 02:13:01,614 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=05814321ef5b00f7e6c218b0a192b8a5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37335,1689559874362; forceNewPlan=false, retain=false 2023-07-17 02:13:01,764 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 02:13:01,770 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=05814321ef5b00f7e6c218b0a192b8a5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:01,770 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559981770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559981770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559981770"}]},"ts":"1689559981770"} 2023-07-17 02:13:01,770 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c7699f846450a343cfb6b1e85b3805c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:01,771 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559981770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559981770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559981770"}]},"ts":"1689559981770"} 2023-07-17 02:13:01,777 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 05814321ef5b00f7e6c218b0a192b8a5, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:13:01,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure c7699f846450a343cfb6b1e85b3805c6, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:13:01,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 02:13:01,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:01,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c7699f846450a343cfb6b1e85b3805c6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 02:13:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 05814321ef5b00f7e6c218b0a192b8a5, NAME => 'testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 02:13:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. service=AccessControlService 2023-07-17 02:13:01,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. service=AccessControlService 2023-07-17 02:13:01,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:13:01,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:13:01,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:01,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:01,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:13:01,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:13:01,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:01,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:01,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:01,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:01,940 INFO [StoreOpener-05814321ef5b00f7e6c218b0a192b8a5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:01,941 INFO [StoreOpener-c7699f846450a343cfb6b1e85b3805c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:01,942 DEBUG [StoreOpener-05814321ef5b00f7e6c218b0a192b8a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/cf 2023-07-17 02:13:01,943 DEBUG [StoreOpener-c7699f846450a343cfb6b1e85b3805c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/cf 2023-07-17 02:13:01,945 DEBUG [StoreOpener-05814321ef5b00f7e6c218b0a192b8a5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/cf 2023-07-17 02:13:01,945 DEBUG [StoreOpener-c7699f846450a343cfb6b1e85b3805c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/cf 2023-07-17 02:13:01,945 INFO [StoreOpener-c7699f846450a343cfb6b1e85b3805c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7699f846450a343cfb6b1e85b3805c6 columnFamilyName cf 2023-07-17 02:13:01,945 INFO [StoreOpener-05814321ef5b00f7e6c218b0a192b8a5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05814321ef5b00f7e6c218b0a192b8a5 columnFamilyName cf 2023-07-17 02:13:01,946 INFO [StoreOpener-c7699f846450a343cfb6b1e85b3805c6-1] regionserver.HStore(310): Store=c7699f846450a343cfb6b1e85b3805c6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:13:01,946 INFO [StoreOpener-05814321ef5b00f7e6c218b0a192b8a5-1] regionserver.HStore(310): Store=05814321ef5b00f7e6c218b0a192b8a5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:13:01,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:01,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:01,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:01,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:01,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:01,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:01,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:13:01,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c7699f846450a343cfb6b1e85b3805c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61028599, jitterRate=-0.09060300886631012}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:13:01,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c7699f846450a343cfb6b1e85b3805c6: 2023-07-17 02:13:01,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6., pid=94, masterSystemTime=1689559981934 2023-07-17 02:13:01,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:13:01,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 05814321ef5b00f7e6c218b0a192b8a5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69018995, jitterRate=0.028463169932365417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:13:01,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 05814321ef5b00f7e6c218b0a192b8a5: 2023-07-17 02:13:01,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5., pid=93, masterSystemTime=1689559981930 2023-07-17 02:13:01,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:01,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:01,963 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c7699f846450a343cfb6b1e85b3805c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:01,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:01,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:01,963 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559981963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559981963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559981963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559981963"}]},"ts":"1689559981963"} 2023-07-17 02:13:01,965 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=05814321ef5b00f7e6c218b0a192b8a5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:01,965 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559981965"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559981965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559981965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559981965"}]},"ts":"1689559981965"} 2023-07-17 02:13:01,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-17 02:13:01,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure c7699f846450a343cfb6b1e85b3805c6, server=jenkins-hbase4.apache.org,35673,1689559874442 in 185 msec 2023-07-17 02:13:01,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-17 02:13:01,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7699f846450a343cfb6b1e85b3805c6, ASSIGN in 359 msec 2023-07-17 02:13:01,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 05814321ef5b00f7e6c218b0a192b8a5, server=jenkins-hbase4.apache.org,37335,1689559874362 in 190 msec 2023-07-17 02:13:01,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-17 02:13:01,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=05814321ef5b00f7e6c218b0a192b8a5, ASSIGN in 360 msec 2023-07-17 02:13:01,972 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 02:13:01,972 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559981972"}]},"ts":"1689559981972"} 2023-07-17 02:13:01,976 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 02:13:01,980 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 02:13:01,980 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-17 02:13:01,982 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 02:13:01,983 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:01,983 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:01,983 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:01,983 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:01,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:01,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:01,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:01,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:01,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 482 msec 2023-07-17 02:13:02,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 02:13:02,113 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-17 02:13:02,113 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-17 02:13:02,113 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:13:02,118 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-17 02:13:02,119 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:13:02,119 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-17 02:13:02,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:13:02,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559982123 (current time:1689559982123). 2023-07-17 02:13:02,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:13:02,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x75ecc4d0 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:13:02,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55f6e40e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:13:02,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:02,137 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:02,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75ecc4d0 to 127.0.0.1:62514 2023-07-17 02:13:02,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:13:02,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x4f63f5ab to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:13:02,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cba62d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:13:02,151 DEBUG [hconnection-0x3e0e3bde-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:02,155 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:02,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:02,163 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:02,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f63f5ab to 127.0.0.1:62514 2023-07-17 02:13:02,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:13:02,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 02:13:02,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:13:02,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:13:02,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:13:02,171 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:13:02,172 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689560582172 2023-07-17 02:13:02,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:13:02,172 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 02:13:02,173 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:13:02,173 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:13:02,175 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:13:02,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 02:13:02,176 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-17 02:13:02,180 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 02:13:02,181 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689560582181 2023-07-17 02:13:02,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,222 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-17 02:13:02,222 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:02,224 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 02:13:02,224 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 02:13:02,224 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,224 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:02,234 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:02,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:02,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:02,234 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:02,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:02,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:02,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:02,235 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,235 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:02,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,235 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,235 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:13:02,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,236 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 02:13:02,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,237 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 02:13:02,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 02:13:02,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,238 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 02:13:02,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 02:13:02,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,238 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 02:13:02,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,251 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 02:13:02,251 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 02:13:02,251 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:02,251 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:02,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 02:13:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 02:13:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 02:13:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 02:13:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 02:13:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 02:13:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:02,260 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 02:13:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 02:13:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 02:13:02,261 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 02:13:02,263 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,263 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:02,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:02,263 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,263 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,264 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:02,264 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,264 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:02,264 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,264 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:02,264 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,264 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:02,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,273 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:02,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:13:02,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:13:02,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:02,274 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:13:02,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 02:13:02,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22c83e67[Count = 1] remaining members to acquire global barrier 2023-07-17 02:13:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:02,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:02,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:02,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:02,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:02,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 02:13:02,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22c83e67[Count = 0] remaining members to acquire global barrier 2023-07-17 02:13:02,288 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 02:13:02,288 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,290 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,290 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,290 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:13:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:13:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 02:13:02,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:13:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:13:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:13:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:13:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:13:02,291 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:13:02,291 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:02,292 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:02,292 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. started... 2023-07-17 02:13:02,292 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. started... 2023-07-17 02:13:02,294 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05814321ef5b00f7e6c218b0a192b8a5: 2023-07-17 02:13:02,294 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c7699f846450a343cfb6b1e85b3805c6: 2023-07-17 02:13:02,294 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,294 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,294 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,294 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:13:02,294 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:13:02,294 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:13:02,294 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,294 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:13:02,294 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:13:02,295 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 02:13:02,295 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:02,296 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 02:13:02,383 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. completed. 2023-07-17 02:13:02,384 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:13:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:13:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 02:13:02,384 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:13:02,386 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 02:13:02,386 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:02,386 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 02:13:02,386 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:02,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:02,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:02,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:02,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:13:02,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 02:13:02,404 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. completed. 2023-07-17 02:13:02,404 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:02,404 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:13:02,404 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:13:02,404 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,404 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 02:13:02,404 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:13:02,406 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 02:13:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 02:13:02,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:02,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:02,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:02,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:13:02,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 02:13:02,411 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 02:13:02,411 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:13:02,411 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:13:02,411 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,411 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:13:02,414 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,414 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,414 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,414 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,415 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:02,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,414 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:02,414 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,415 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:02,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:02,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:02,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:02,416 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:02,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,420 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:02,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,424 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,426 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,428 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,433 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,433 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:02,433 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:02,433 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:02,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:02,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:02,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:02,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:02,434 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:02,434 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-17 02:13:02,434 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:02,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:02,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:02,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,475 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:02,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:13:02,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:13:02,476 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 02:13:02,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,777 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:02,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:13:02,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:13:02,778 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 02:13:02,912 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 02:13:02,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,913 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:02,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689559982172Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689559982434 (+262 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689559982434Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689559982445 (+11 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689559982471 (+26 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689559982912 (+441 ms) 2023-07-17 02:13:02,917 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 02:13:02,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 743 msec 2023-07-17 02:13:03,278 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:03,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:13:03,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:13:03,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37335] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:13:03,291 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35673] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:13:03,296 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 02:13:03,296 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:03,297 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:13:03,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:13:03,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559983312 (current time:1689559983312). 2023-07-17 02:13:03,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:13:03,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x111df35a to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:13:03,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e02ea6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:13:03,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:03,366 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:03,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x111df35a to 127.0.0.1:62514 2023-07-17 02:13:03,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:13:03,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x7de9d145 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:13:03,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3906a81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:13:03,392 DEBUG [hconnection-0x4a08b115-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:03,393 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:03,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:03,404 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:03,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7de9d145 to 127.0.0.1:62514 2023-07-17 02:13:03,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:13:03,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 02:13:03,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:13:03,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:13:03,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:13:03,412 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:13:03,414 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689560583414 2023-07-17 02:13:03,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 02:13:03,415 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 02:13:03,416 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:13:03,416 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:13:03,418 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 02:13:03,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 02:13:03,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-17 02:13:03,422 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 02:13:03,423 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689560583423 2023-07-17 02:13:03,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,458 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-17 02:13:03,458 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:03,460 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 02:13:03,460 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 02:13:03,463 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,463 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,464 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:03,464 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:03,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:03,464 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:03,464 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:03,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,465 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,465 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,466 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,466 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:13:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 02:13:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 02:13:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 02:13:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,476 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 02:13:03,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,476 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 02:13:03,476 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 02:13:03,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,483 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 02:13:03,495 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:03,495 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,488 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,497 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 02:13:03,497 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 02:13:03,497 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:03,497 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 02:13:03,499 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 02:13:03,497 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:03,499 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 02:13:03,499 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 02:13:03,502 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 02:13:03,502 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 02:13:03,503 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 02:13:03,503 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 02:13:03,503 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 02:13:03,504 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,504 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,504 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:03,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:03,504 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,505 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,507 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,507 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,507 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,507 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:03,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:03,507 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:03,507 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:03,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:03,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:03,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 02:13:03,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@401b34ab[Count = 1] remaining members to acquire global barrier 2023-07-17 02:13:03,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:03,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:03,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:03,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:03,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:03,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 02:13:03,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@401b34ab[Count = 0] remaining members to acquire global barrier 2023-07-17 02:13:03,512 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 02:13:03,512 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:13:03,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,517 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:13:03,517 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,517 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 02:13:03,517 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 02:13:03,517 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:13:03,518 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,518 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:13:03,518 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:03,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:13:03,519 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 02:13:03,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:13:03,519 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:03,519 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 02:13:03,519 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:13:03,532 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:13:03,532 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:03,532 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:13:03,532 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. started... 2023-07-17 02:13:03,532 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:13:03,532 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:13:03,532 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:03,532 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. started... 2023-07-17 02:13:03,533 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c7699f846450a343cfb6b1e85b3805c6 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 02:13:03,533 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 05814321ef5b00f7e6c218b0a192b8a5 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 02:13:03,569 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/.tmp/cf/0f3485f1bf8d4aa0ade03d287cb6aa0f 2023-07-17 02:13:03,571 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/.tmp/cf/4d469063ae7e47a89678ebf2f6e6424d 2023-07-17 02:13:03,587 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/.tmp/cf/0f3485f1bf8d4aa0ade03d287cb6aa0f as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/cf/0f3485f1bf8d4aa0ade03d287cb6aa0f 2023-07-17 02:13:03,589 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/.tmp/cf/4d469063ae7e47a89678ebf2f6e6424d as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/cf/4d469063ae7e47a89678ebf2f6e6424d 2023-07-17 02:13:03,599 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/cf/4d469063ae7e47a89678ebf2f6e6424d, entries=3, sequenceid=6, filesize=5.0 K 2023-07-17 02:13:03,600 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 05814321ef5b00f7e6c218b0a192b8a5 in 67ms, sequenceid=6, compaction requested=false 2023-07-17 02:13:03,600 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-17 02:13:03,601 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05814321ef5b00f7e6c218b0a192b8a5: 2023-07-17 02:13:03,601 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,603 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:13:03,603 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/cf/4d469063ae7e47a89678ebf2f6e6424d] hfiles 2023-07-17 02:13:03,603 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/cf/4d469063ae7e47a89678ebf2f6e6424d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,609 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/cf/0f3485f1bf8d4aa0ade03d287cb6aa0f, entries=47, sequenceid=6, filesize=8 K 2023-07-17 02:13:03,611 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c7699f846450a343cfb6b1e85b3805c6 in 78ms, sequenceid=6, compaction requested=false 2023-07-17 02:13:03,616 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c7699f846450a343cfb6b1e85b3805c6: 2023-07-17 02:13:03,616 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,616 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:13:03,616 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/cf/0f3485f1bf8d4aa0ade03d287cb6aa0f] hfiles 2023-07-17 02:13:03,616 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/cf/0f3485f1bf8d4aa0ade03d287cb6aa0f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,662 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. completed. 2023-07-17 02:13:03,662 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:13:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:13:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 02:13:03,662 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:13:03,664 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,664 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 02:13:03,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:03,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:03,664 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:03,665 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 02:13:03,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:03,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:03,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:03,670 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. completed. 2023-07-17 02:13:03,670 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:03,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,670 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:13:03,670 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:13:03,671 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,671 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 02:13:03,671 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:13:03,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,675 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 02:13:03,675 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,675 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:03,675 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 02:13:03,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:13:03,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 02:13:03,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:03,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:03,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:03,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:03,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:13:03,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 02:13:03,682 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 02:13:03,682 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:13:03,683 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:13:03,683 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,683 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:13:03,685 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,685 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:03,685 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,685 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,686 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:03,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,686 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:03,686 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:03,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:03,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:03,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,688 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:03,688 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:03,689 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,693 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,694 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,694 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:03,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:03,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:03,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:03,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:03,700 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:03,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:03,700 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:03,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:03,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:03,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,700 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:03,702 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,702 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,702 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:03,702 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,702 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:03,703 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:03,703 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,703 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:03,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:03,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:03,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,719 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:03,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:13:03,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:13:03,721 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 02:13:03,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,821 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 02:13:03,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,822 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:03,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689559983415Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689559983700 (+285 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689559983700Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689559983716 (+16 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689559983744 (+28 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689559983821 (+77 ms) 2023-07-17 02:13:03,826 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 02:13:03,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 410 msec 2023-07-17 02:13:04,021 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:04,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 02:13:04,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:13:04,023 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023 2023-07-17 02:13:04,023 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39797, tgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023, rawTgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023, srcFsUri=hdfs://localhost:39797, srcDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:13:04,061 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:13:04,061 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-365653939_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:04,061 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1, snapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-17 02:13:04,071 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:04,135 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:04,136 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:04,136 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:04,137 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:04,858 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0005_000001 (auth:SIMPLE) 2023-07-17 02:13:05,392 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-7250966557108955965.jar 2023-07-17 02:13:05,393 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:05,393 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:05,484 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-7328615131146292552.jar 2023-07-17 02:13:05,484 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:05,485 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:05,485 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:05,486 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:05,487 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:05,487 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:05,488 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 02:13:05,488 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 02:13:05,489 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 02:13:05,489 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 02:13:05,489 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 02:13:05,490 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 02:13:05,491 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 02:13:05,491 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 02:13:05,491 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 02:13:05,492 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 02:13:05,493 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:13:05,493 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:13:05,494 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:13:05,495 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:13:05,495 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:13:05,496 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:13:05,496 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:13:06,372 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 02:13:06,838 WARN [Listener at jenkins-hbase4.apache.org/46125] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 02:13:06,841 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-17 02:13:07,370 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:13:07,370 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:13:07,511 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0006_000001 (auth:SIMPLE) 2023-07-17 02:13:13,500 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0006_000001 (auth:SIMPLE) 2023-07-17 02:13:16,697 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 02:13:16,698 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 02:13:16,704 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:16,704 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 02:13:16,705 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 02:13:16,705 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:16,705 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 02:13:16,706 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 02:13:16,706 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:16,706 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 02:13:16,706 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559984023/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 02:13:16,713 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-17 02:13:16,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-17 02:13:16,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 02:13:16,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 02:13:16,720 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559996720"}]},"ts":"1689559996720"} 2023-07-17 02:13:16,723 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 02:13:16,730 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-17 02:13:16,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=05814321ef5b00f7e6c218b0a192b8a5, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7699f846450a343cfb6b1e85b3805c6, UNASSIGN}] 2023-07-17 02:13:16,734 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=05814321ef5b00f7e6c218b0a192b8a5, UNASSIGN 2023-07-17 02:13:16,734 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7699f846450a343cfb6b1e85b3805c6, UNASSIGN 2023-07-17 02:13:16,735 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=05814321ef5b00f7e6c218b0a192b8a5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:16,735 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559996735"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559996735"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559996735"}]},"ts":"1689559996735"} 2023-07-17 02:13:16,735 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c7699f846450a343cfb6b1e85b3805c6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:16,735 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559996735"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559996735"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559996735"}]},"ts":"1689559996735"} 2023-07-17 02:13:16,737 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 05814321ef5b00f7e6c218b0a192b8a5, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:13:16,738 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure c7699f846450a343cfb6b1e85b3805c6, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:13:16,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 02:13:16,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:16,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 05814321ef5b00f7e6c218b0a192b8a5, disabling compactions & flushes 2023-07-17 02:13:16,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:16,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:16,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. after waiting 0 ms 2023-07-17 02:13:16,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:16,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:16,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c7699f846450a343cfb6b1e85b3805c6, disabling compactions & flushes 2023-07-17 02:13:16,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:16,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:16,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. after waiting 0 ms 2023-07-17 02:13:16,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:16,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:13:16,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:13:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:13:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:13:16,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6. 2023-07-17 02:13:16,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c7699f846450a343cfb6b1e85b3805c6: 2023-07-17 02:13:16,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5. 2023-07-17 02:13:16,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 05814321ef5b00f7e6c218b0a192b8a5: 2023-07-17 02:13:16,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:16,917 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c7699f846450a343cfb6b1e85b3805c6, regionState=CLOSED 2023-07-17 02:13:16,917 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559996917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559996917"}]},"ts":"1689559996917"} 2023-07-17 02:13:16,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:16,918 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=05814321ef5b00f7e6c218b0a192b8a5, regionState=CLOSED 2023-07-17 02:13:16,918 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689559996918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559996918"}]},"ts":"1689559996918"} 2023-07-17 02:13:16,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-17 02:13:16,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-17 02:13:16,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure c7699f846450a343cfb6b1e85b3805c6, server=jenkins-hbase4.apache.org,35673,1689559874442 in 181 msec 2023-07-17 02:13:16,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 05814321ef5b00f7e6c218b0a192b8a5, server=jenkins-hbase4.apache.org,37335,1689559874362 in 188 msec 2023-07-17 02:13:16,928 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=05814321ef5b00f7e6c218b0a192b8a5, UNASSIGN in 196 msec 2023-07-17 02:13:16,932 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-17 02:13:16,933 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c7699f846450a343cfb6b1e85b3805c6, UNASSIGN in 196 msec 2023-07-17 02:13:16,933 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559996933"}]},"ts":"1689559996933"} 2023-07-17 02:13:16,935 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 02:13:16,937 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-17 02:13:16,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 223 msec 2023-07-17 02:13:17,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 02:13:17,021 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-17 02:13:17,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,027 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,027 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,029 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,033 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:17,033 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:17,035 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/recovered.edits] 2023-07-17 02:13:17,035 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,035 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,035 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,035 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,035 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/recovered.edits] 2023-07-17 02:13:17,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 02:13:17,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 02:13:17,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 02:13:17,037 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,037 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:17,037 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,037 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:17,037 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-17 02:13:17,037 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 02:13:17,037 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,037 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:17,037 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:17,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 02:13:17,044 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/cf/0f3485f1bf8d4aa0ade03d287cb6aa0f to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/cf/0f3485f1bf8d4aa0ade03d287cb6aa0f 2023-07-17 02:13:17,047 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/cf/4d469063ae7e47a89678ebf2f6e6424d to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/cf/4d469063ae7e47a89678ebf2f6e6424d 2023-07-17 02:13:17,050 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6/recovered.edits/9.seqid 2023-07-17 02:13:17,051 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/c7699f846450a343cfb6b1e85b3805c6 2023-07-17 02:13:17,053 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5/recovered.edits/9.seqid 2023-07-17 02:13:17,053 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testEmptyExportFileSystemState/05814321ef5b00f7e6c218b0a192b8a5 2023-07-17 02:13:17,053 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 02:13:17,056 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,058 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-17 02:13:17,061 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-17 02:13:17,062 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,062 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-17 02:13:17,062 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559997062"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:17,062 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689559997062"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:17,064 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 02:13:17,064 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 05814321ef5b00f7e6c218b0a192b8a5, NAME => 'testtb-testEmptyExportFileSystemState,,1689559981502.05814321ef5b00f7e6c218b0a192b8a5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c7699f846450a343cfb6b1e85b3805c6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689559981502.c7699f846450a343cfb6b1e85b3805c6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 02:13:17,064 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-17 02:13:17,064 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689559997064"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:17,067 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-17 02:13:17,069 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 02:13:17,070 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 46 msec 2023-07-17 02:13:17,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 02:13:17,140 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-17 02:13:17,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-17 02:13:17,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:17,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-17 02:13:17,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-17 02:13:17,183 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=767 (was 760) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:44868 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2114031406_1 at /127.0.0.1:44844 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:54396 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1331493568_17 at /127.0.0.1:36028 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:46589 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2114031406_1 at /127.0.0.1:54376 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:36465 from appattempt_1689559883575_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4606 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x798c2dbc-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=523 (was 509) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=1462 (was 2088) 2023-07-17 02:13:17,183 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-17 02:13:17,210 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=523, ProcessCount=181, AvailableMemoryMB=1460 2023-07-17 02:13:17,210 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-17 02:13:17,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 02:13:17,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,216 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 02:13:17,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-17 02:13:17,217 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 02:13:17,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 02:13:17,220 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:17,220 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:17,220 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0 empty. 2023-07-17 02:13:17,220 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf empty. 2023-07-17 02:13:17,221 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:17,221 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:17,221 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 02:13:17,233 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-17 02:13:17,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9be4a3b73e6be5ec14ac9ec99dfaeadf, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:13:17,235 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5445d768825cc32b2b556994b3a14ea0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp 2023-07-17 02:13:17,260 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:13:17,260 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:13:17,260 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 5445d768825cc32b2b556994b3a14ea0, disabling compactions & flushes 2023-07-17 02:13:17,261 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:17,261 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:17,261 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. after waiting 0 ms 2023-07-17 02:13:17,261 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:17,260 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 9be4a3b73e6be5ec14ac9ec99dfaeadf, disabling compactions & flushes 2023-07-17 02:13:17,261 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:17,261 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:17,261 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 5445d768825cc32b2b556994b3a14ea0: 2023-07-17 02:13:17,261 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:17,261 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. after waiting 0 ms 2023-07-17 02:13:17,261 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:17,261 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:17,261 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 9be4a3b73e6be5ec14ac9ec99dfaeadf: 2023-07-17 02:13:17,264 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 02:13:17,265 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689559997265"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559997265"}]},"ts":"1689559997265"} 2023-07-17 02:13:17,265 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689559997265"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689559997265"}]},"ts":"1689559997265"} 2023-07-17 02:13:17,274 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 02:13:17,275 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 02:13:17,275 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559997275"}]},"ts":"1689559997275"} 2023-07-17 02:13:17,276 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-17 02:13:17,285 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 02:13:17,286 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 02:13:17,286 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 02:13:17,286 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 02:13:17,286 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 02:13:17,286 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5445d768825cc32b2b556994b3a14ea0, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9be4a3b73e6be5ec14ac9ec99dfaeadf, ASSIGN}] 2023-07-17 02:13:17,293 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9be4a3b73e6be5ec14ac9ec99dfaeadf, ASSIGN 2023-07-17 02:13:17,293 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5445d768825cc32b2b556994b3a14ea0, ASSIGN 2023-07-17 02:13:17,293 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9be4a3b73e6be5ec14ac9ec99dfaeadf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37335,1689559874362; forceNewPlan=false, retain=false 2023-07-17 02:13:17,294 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5445d768825cc32b2b556994b3a14ea0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35673,1689559874442; forceNewPlan=false, retain=false 2023-07-17 02:13:17,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 02:13:17,444 INFO [jenkins-hbase4:40829] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 02:13:17,447 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5445d768825cc32b2b556994b3a14ea0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,447 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9be4a3b73e6be5ec14ac9ec99dfaeadf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,448 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689559997447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559997447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559997447"}]},"ts":"1689559997447"} 2023-07-17 02:13:17,448 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689559997447"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689559997447"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689559997447"}]},"ts":"1689559997447"} 2023-07-17 02:13:17,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 5445d768825cc32b2b556994b3a14ea0, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:13:17,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 9be4a3b73e6be5ec14ac9ec99dfaeadf, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:13:17,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 02:13:17,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:17,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:17,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5445d768825cc32b2b556994b3a14ea0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9be4a3b73e6be5ec14ac9ec99dfaeadf, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. service=AccessControlService 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. service=AccessControlService 2023-07-17 02:13:17,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:13:17,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:17,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:17,609 INFO [StoreOpener-9be4a3b73e6be5ec14ac9ec99dfaeadf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:17,609 INFO [StoreOpener-5445d768825cc32b2b556994b3a14ea0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:17,611 DEBUG [StoreOpener-9be4a3b73e6be5ec14ac9ec99dfaeadf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/cf 2023-07-17 02:13:17,611 DEBUG [StoreOpener-9be4a3b73e6be5ec14ac9ec99dfaeadf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/cf 2023-07-17 02:13:17,611 DEBUG [StoreOpener-5445d768825cc32b2b556994b3a14ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/cf 2023-07-17 02:13:17,611 DEBUG [StoreOpener-5445d768825cc32b2b556994b3a14ea0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/cf 2023-07-17 02:13:17,611 INFO [StoreOpener-9be4a3b73e6be5ec14ac9ec99dfaeadf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9be4a3b73e6be5ec14ac9ec99dfaeadf columnFamilyName cf 2023-07-17 02:13:17,611 INFO [StoreOpener-5445d768825cc32b2b556994b3a14ea0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5445d768825cc32b2b556994b3a14ea0 columnFamilyName cf 2023-07-17 02:13:17,612 INFO [StoreOpener-9be4a3b73e6be5ec14ac9ec99dfaeadf-1] regionserver.HStore(310): Store=9be4a3b73e6be5ec14ac9ec99dfaeadf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:13:17,612 INFO [StoreOpener-5445d768825cc32b2b556994b3a14ea0-1] regionserver.HStore(310): Store=5445d768825cc32b2b556994b3a14ea0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 02:13:17,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:17,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:17,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:17,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:17,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:13:17,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9be4a3b73e6be5ec14ac9ec99dfaeadf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60850606, jitterRate=-0.09325531125068665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:13:17,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 02:13:17,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9be4a3b73e6be5ec14ac9ec99dfaeadf: 2023-07-17 02:13:17,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf., pid=109, masterSystemTime=1689559997602 2023-07-17 02:13:17,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5445d768825cc32b2b556994b3a14ea0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74675102, jitterRate=0.1127457320690155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 02:13:17,639 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5445d768825cc32b2b556994b3a14ea0: 2023-07-17 02:13:17,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0., pid=108, masterSystemTime=1689559997602 2023-07-17 02:13:17,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:17,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:17,644 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9be4a3b73e6be5ec14ac9ec99dfaeadf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,644 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689559997644"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559997644"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559997644"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559997644"}]},"ts":"1689559997644"} 2023-07-17 02:13:17,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:17,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:17,646 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5445d768825cc32b2b556994b3a14ea0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,646 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689559997646"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689559997646"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689559997646"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689559997646"}]},"ts":"1689559997646"} 2023-07-17 02:13:17,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-17 02:13:17,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 9be4a3b73e6be5ec14ac9ec99dfaeadf, server=jenkins-hbase4.apache.org,37335,1689559874362 in 196 msec 2023-07-17 02:13:17,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-17 02:13:17,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 5445d768825cc32b2b556994b3a14ea0, server=jenkins-hbase4.apache.org,35673,1689559874442 in 198 msec 2023-07-17 02:13:17,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9be4a3b73e6be5ec14ac9ec99dfaeadf, ASSIGN in 363 msec 2023-07-17 02:13:17,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-17 02:13:17,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5445d768825cc32b2b556994b3a14ea0, ASSIGN in 364 msec 2023-07-17 02:13:17,652 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 02:13:17,652 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689559997652"}]},"ts":"1689559997652"} 2023-07-17 02:13:17,653 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-17 02:13:17,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 02:13:17,655 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-17 02:13:17,657 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 02:13:17,658 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:17,658 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:17,658 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:17,658 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:17,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:17,659 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:17,660 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:17,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 447 msec 2023-07-17 02:13:17,661 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 02:13:17,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 02:13:17,822 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-17 02:13:17,822 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-17 02:13:17,822 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:13:17,826 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-17 02:13:17,826 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:13:17,826 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-17 02:13:17,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 02:13:17,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559997829 (current time:1689559997829). 2023-07-17 02:13:17,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:13:17,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x6bda36c2 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:13:17,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cfb7339, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:13:17,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:17,846 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:17,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bda36c2 to 127.0.0.1:62514 2023-07-17 02:13:17,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:13:17,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x08293deb to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:13:17,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@327f760a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:13:17,856 DEBUG [hconnection-0x15baa9c7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:17,859 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:17,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:17,865 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:17,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08293deb to 127.0.0.1:62514 2023-07-17 02:13:17,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:13:17,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 02:13:17,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:13:17,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 02:13:17,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 02:13:17,870 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 02:13:17,871 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689560597871 2023-07-17 02:13:17,871 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 02:13:17,872 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:13:17,872 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:13:17,873 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 02:13:17,873 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 02:13:17,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-17 02:13:17,875 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 02:13:17,876 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689560597876 2023-07-17 02:13:17,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,890 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 02:13:17,890 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:17,891 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 02:13:17,891 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 02:13:17,892 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,892 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,893 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:17,893 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:17,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:17,893 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:17,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:17,893 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:17,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:17,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:17,893 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,893 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,894 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,894 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 02:13:17,895 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 02:13:17,895 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:17,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,895 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 02:13:17,895 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:17,897 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,898 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 02:13:17,898 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 02:13:17,898 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:17,898 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 02:13:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 02:13:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 02:13:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 02:13:17,898 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 02:13:17,900 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 02:13:17,900 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 02:13:17,899 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 02:13:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,905 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:17,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:17,905 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,905 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:17,906 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:17,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:17,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:17,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 02:13:17,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a5cc9af[Count = 1] remaining members to acquire global barrier 2023-07-17 02:13:17,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:17,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:17,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:17,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 02:13:17,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a5cc9af[Count = 0] remaining members to acquire global barrier 2023-07-17 02:13:17,911 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 02:13:17,911 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,912 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,912 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,912 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 02:13:17,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,913 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 02:13:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 02:13:17,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:13:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 02:13:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:13:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:13:17,913 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:17,913 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. started... 2023-07-17 02:13:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:13:17,913 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:13:17,913 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:17,913 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. started... 2023-07-17 02:13:17,913 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,915 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:13:17,915 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9be4a3b73e6be5ec14ac9ec99dfaeadf: 2023-07-17 02:13:17,916 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5445d768825cc32b2b556994b3a14ea0: 2023-07-17 02:13:17,916 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,916 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,916 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:13:17,916 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:13:17,916 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:13:17,916 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 02:13:17,917 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 02:13:17,917 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:17,917 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 02:13:17,929 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. completed. 2023-07-17 02:13:17,929 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:17,929 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:13:17,929 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:13:17,929 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,929 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 02:13:17,930 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:13:17,930 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. completed. 2023-07-17 02:13:17,930 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:17,930 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:13:17,930 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:13:17,930 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,930 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 02:13:17,930 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:13:17,932 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 02:13:17,932 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,932 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:17,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:17,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:17,932 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 02:13:17,934 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,934 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 02:13:17,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:17,934 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:17,934 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 02:13:17,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:17,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:17,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:13:17,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 02:13:17,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:17,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:17,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:17,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:13:17,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 02:13:17,942 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 02:13:17,942 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:13:17,942 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:13:17,942 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,942 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:13:17,944 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,945 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,945 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,945 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:17,945 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,945 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:17,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:17,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,946 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:17,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:17,947 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,947 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:17,947 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,951 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:17,951 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,951 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:17,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:17,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:17,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:17,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:17,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:17,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:17,954 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:17,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:17,954 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:17,955 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,956 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:17,957 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,957 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:17,957 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:17,957 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,957 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:17,975 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:17,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 02:13:17,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:13:17,977 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:13:18,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 02:13:18,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,037 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689559997871Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689559997954 (+83 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689559997955 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689559997963 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689559997989 (+26 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689559998037 (+48 ms) 2023-07-17 02:13:18,040 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 02:13:18,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 168 msec 2023-07-17 02:13:18,177 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:18,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 02:13:18,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:13:18,185 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35673] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:13:18,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37335] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 02:13:18,190 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,190 DEBUG [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:18,190 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 02:13:18,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 02:13:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689559998200 (current time:1689559998200). 2023-07-17 02:13:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 02:13:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x1d56635f to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:13:18,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5de205a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:13:18,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:18,221 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:18,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d56635f to 127.0.0.1:62514 2023-07-17 02:13:18,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:13:18,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(139): Connect 0x21901f18 to 127.0.0.1:62514 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 02:13:18,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f72ccee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 02:13:18,232 DEBUG [hconnection-0x42f00fbe-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:18,235 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:18,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 02:13:18,242 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 02:13:18,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21901f18 to 127.0.0.1:62514 2023-07-17 02:13:18,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:13:18,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 02:13:18,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 02:13:18,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 02:13:18,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 02:13:18,248 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 02:13:18,251 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689560598251 2023-07-17 02:13:18,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 02:13:18,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,252 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 02:13:18,252 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 02:13:18,256 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 02:13:18,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 02:13:18,258 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-17 02:13:18,259 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 02:13:18,260 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689560598260 2023-07-17 02:13:18,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,285 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 02:13:18,285 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:18,287 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 02:13:18,287 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 02:13:18,288 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,288 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,290 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:18,290 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:18,290 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:18,290 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:18,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:18,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:18,291 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,291 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:18,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:18,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:18,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,291 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,291 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 02:13:18,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 02:13:18,292 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 02:13:18,300 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,301 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 02:13:18,301 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:18,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,302 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 02:13:18,302 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,302 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 02:13:18,302 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:18,302 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 02:13:18,304 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 02:13:18,304 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 02:13:18,302 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 02:13:18,304 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 02:13:18,304 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 02:13:18,306 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 02:13:18,306 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 02:13:18,306 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 02:13:18,306 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45215,1689559874524' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 02:13:18,307 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:18,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:18,307 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,308 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,308 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:18,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:18,309 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,310 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:18,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:18,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,310 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,311 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 02:13:18,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:18,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35673,1689559874442' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 02:13:18,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cf2c48c[Count = 1] remaining members to acquire global barrier 2023-07-17 02:13:18,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:18,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:18,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:18,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:18,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:18,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37335,1689559874362' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 02:13:18,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cf2c48c[Count = 0] remaining members to acquire global barrier 2023-07-17 02:13:18,315 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 02:13:18,315 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 02:13:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,322 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 02:13:18,322 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 02:13:18,322 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 02:13:18,322 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45215,1689559874524' in zk 2023-07-17 02:13:18,322 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:13:18,322 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:13:18,322 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:18,322 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,323 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 02:13:18,323 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. started... 2023-07-17 02:13:18,323 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9be4a3b73e6be5ec14ac9ec99dfaeadf 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 02:13:18,324 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 02:13:18,324 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:18,324 DEBUG [member: 'jenkins-hbase4.apache.org,45215,1689559874524' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 02:13:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 02:13:18,326 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 02:13:18,328 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:18,329 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. started... 2023-07-17 02:13:18,329 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5445d768825cc32b2b556994b3a14ea0 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 02:13:18,352 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:18,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 02:13:18,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 02:13:18,353 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 02:13:18,361 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/.tmp/cf/f2922e4a0ea041e8a02aacf8f741eaf9 2023-07-17 02:13:18,362 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/.tmp/cf/c007eb11f5824ab79b7923d289743610 2023-07-17 02:13:18,367 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/.tmp/cf/f2922e4a0ea041e8a02aacf8f741eaf9 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/cf/f2922e4a0ea041e8a02aacf8f741eaf9 2023-07-17 02:13:18,368 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/.tmp/cf/c007eb11f5824ab79b7923d289743610 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/cf/c007eb11f5824ab79b7923d289743610 2023-07-17 02:13:18,373 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/cf/c007eb11f5824ab79b7923d289743610, entries=48, sequenceid=6, filesize=8.1 K 2023-07-17 02:13:18,374 INFO [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 9be4a3b73e6be5ec14ac9ec99dfaeadf in 51ms, sequenceid=6, compaction requested=false 2023-07-17 02:13:18,374 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-17 02:13:18,375 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9be4a3b73e6be5ec14ac9ec99dfaeadf: 2023-07-17 02:13:18,375 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,375 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:13:18,375 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/cf/c007eb11f5824ab79b7923d289743610] hfiles 2023-07-17 02:13:18,375 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/cf/c007eb11f5824ab79b7923d289743610 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,377 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/cf/f2922e4a0ea041e8a02aacf8f741eaf9, entries=2, sequenceid=6, filesize=5.0 K 2023-07-17 02:13:18,378 INFO [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 5445d768825cc32b2b556994b3a14ea0 in 49ms, sequenceid=6, compaction requested=false 2023-07-17 02:13:18,380 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5445d768825cc32b2b556994b3a14ea0: 2023-07-17 02:13:18,381 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,381 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 02:13:18,381 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/cf/f2922e4a0ea041e8a02aacf8f741eaf9] hfiles 2023-07-17 02:13:18,381 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/cf/f2922e4a0ea041e8a02aacf8f741eaf9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,391 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. completed. 2023-07-17 02:13:18,391 DEBUG [rs(jenkins-hbase4.apache.org,37335,1689559874362)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:18,391 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:13:18,391 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:13:18,391 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,391 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 02:13:18,391 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37335,1689559874362' in zk 2023-07-17 02:13:18,393 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 02:13:18,393 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,393 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:18,393 DEBUG [member: 'jenkins-hbase4.apache.org,37335,1689559874362' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 02:13:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:18,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37335,1689559874362': 2023-07-17 02:13:18,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37335,1689559874362' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 02:13:18,406 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. completed. 2023-07-17 02:13:18,406 DEBUG [rs(jenkins-hbase4.apache.org,35673,1689559874442)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:18,406 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 02:13:18,406 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 02:13:18,406 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,406 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 02:13:18,406 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35673,1689559874442' in zk 2023-07-17 02:13:18,408 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,408 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 02:13:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:18,408 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:18,408 DEBUG [member: 'jenkins-hbase4.apache.org,35673,1689559874442' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 02:13:18,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:18,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:18,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35673,1689559874442': 2023-07-17 02:13:18,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35673,1689559874442' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 02:13:18,414 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 02:13:18,414 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 02:13:18,414 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 02:13:18,414 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,414 INFO [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 02:13:18,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:18,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:18,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:18,418 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,418 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 02:13:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 02:13:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:18,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:18,420 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 02:13:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,420 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 02:13:18,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,422 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 02:13:18,423 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,423 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,428 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:18,428 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:18,428 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:18,428 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 02:13:18,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:18,428 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,428 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:18,428 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:18,428 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:18,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,428 DEBUG [(jenkins-hbase4.apache.org,40829,1689559872752)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 02:13:18,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 02:13:18,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:18,430 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 02:13:18,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:18,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:18,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 02:13:18,428 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,430 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,430 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,430 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:13:18,431 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:18,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:18,431 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:18,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,431 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:18,431 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,431 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 02:13:18,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 02:13:18,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 02:13:18,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,531 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689559998251Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689559998428 (+177 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689559998428Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689559998436 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689559998468 (+32 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689559998531 (+63 ms) 2023-07-17 02:13:18,535 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 02:13:18,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 279 msec 2023-07-17 02:13:18,554 DEBUG [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 02:13:18,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 02:13:18,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 02:13:18,555 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555 2023-07-17 02:13:18,555 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:39797, tgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555, rawTgtDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555, srcFsUri=hdfs://localhost:39797, srcDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:13:18,585 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1 2023-07-17 02:13:18,585 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1834385379_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,585 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:39797, inputRoot=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1, snapshotDir=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-17 02:13:18,602 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:18,672 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:18,673 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:18,673 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:18,673 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:19,782 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-8001832036216129589.jar 2023-07-17 02:13:19,783 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:19,783 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:19,880 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/hadoop-8061767801568561862.jar 2023-07-17 02:13:19,881 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:19,881 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:19,882 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:19,883 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:19,883 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:19,884 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 02:13:19,884 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 02:13:19,885 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 02:13:19,885 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 02:13:19,886 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 02:13:19,886 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 02:13:19,887 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 02:13:19,888 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 02:13:19,888 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 02:13:19,889 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 02:13:19,889 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 02:13:19,890 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:13:19,891 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:13:19,892 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:13:19,892 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:13:19,892 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 02:13:19,893 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:13:19,894 DEBUG [Listener at jenkins-hbase4.apache.org/46125] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 02:13:20,514 WARN [Listener at jenkins-hbase4.apache.org/46125] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 02:13:20,517 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-17 02:13:20,518 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-17 02:13:20,879 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:13:20,879 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 02:13:20,883 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0006_000001 (auth:SIMPLE) 2023-07-17 02:13:21,869 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0007_000001 (auth:SIMPLE) 2023-07-17 02:13:22,564 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 02:13:28,617 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0007_000001 (auth:SIMPLE) 2023-07-17 02:13:30,957 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0007_000001 (auth:SIMPLE) 2023-07-17 02:13:34,892 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689559883575_0007_000001 (auth:SIMPLE) 2023-07-17 02:13:36,786 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 02:13:36,786 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 02:13:36,802 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:36,802 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 02:13:36,802 INFO [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 02:13:36,803 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:36,803 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 02:13:36,803 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 02:13:36,804 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1331493568_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:36,804 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 02:13:36,804 DEBUG [Listener at jenkins-hbase4.apache.org/46125] snapshot.TestExportSnapshot(367): hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/export-test/export-1689559998555/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 02:13:36,817 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:36,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:36,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:36,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 02:13:36,823 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689560016822"}]},"ts":"1689560016822"} 2023-07-17 02:13:36,824 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-17 02:13:36,826 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-17 02:13:36,828 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5445d768825cc32b2b556994b3a14ea0, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9be4a3b73e6be5ec14ac9ec99dfaeadf, UNASSIGN}] 2023-07-17 02:13:36,830 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9be4a3b73e6be5ec14ac9ec99dfaeadf, UNASSIGN 2023-07-17 02:13:36,831 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5445d768825cc32b2b556994b3a14ea0, UNASSIGN 2023-07-17 02:13:36,832 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9be4a3b73e6be5ec14ac9ec99dfaeadf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:13:36,832 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5445d768825cc32b2b556994b3a14ea0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:13:36,832 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689560016831"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689560016831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689560016831"}]},"ts":"1689560016831"} 2023-07-17 02:13:36,832 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689560016831"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689560016831"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689560016831"}]},"ts":"1689560016831"} 2023-07-17 02:13:36,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 9be4a3b73e6be5ec14ac9ec99dfaeadf, server=jenkins-hbase4.apache.org,37335,1689559874362}] 2023-07-17 02:13:36,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 5445d768825cc32b2b556994b3a14ea0, server=jenkins-hbase4.apache.org,35673,1689559874442}] 2023-07-17 02:13:36,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 02:13:36,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:36,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9be4a3b73e6be5ec14ac9ec99dfaeadf, disabling compactions & flushes 2023-07-17 02:13:36,986 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:36,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:36,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. after waiting 0 ms 2023-07-17 02:13:36,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:36,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:36,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5445d768825cc32b2b556994b3a14ea0, disabling compactions & flushes 2023-07-17 02:13:36,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:36,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:36,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. after waiting 0 ms 2023-07-17 02:13:36,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:37,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:13:37,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:13:37,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:13:37,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:13:37,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf. 2023-07-17 02:13:37,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9be4a3b73e6be5ec14ac9ec99dfaeadf: 2023-07-17 02:13:37,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0. 2023-07-17 02:13:37,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5445d768825cc32b2b556994b3a14ea0: 2023-07-17 02:13:37,064 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:37,065 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9be4a3b73e6be5ec14ac9ec99dfaeadf, regionState=CLOSED 2023-07-17 02:13:37,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:37,065 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689560017065"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689560017065"}]},"ts":"1689560017065"} 2023-07-17 02:13:37,066 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=5445d768825cc32b2b556994b3a14ea0, regionState=CLOSED 2023-07-17 02:13:37,066 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689560017066"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689560017066"}]},"ts":"1689560017066"} 2023-07-17 02:13:37,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-17 02:13:37,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 9be4a3b73e6be5ec14ac9ec99dfaeadf, server=jenkins-hbase4.apache.org,37335,1689559874362 in 234 msec 2023-07-17 02:13:37,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-17 02:13:37,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9be4a3b73e6be5ec14ac9ec99dfaeadf, UNASSIGN in 241 msec 2023-07-17 02:13:37,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 5445d768825cc32b2b556994b3a14ea0, server=jenkins-hbase4.apache.org,35673,1689559874442 in 234 msec 2023-07-17 02:13:37,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-17 02:13:37,076 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5445d768825cc32b2b556994b3a14ea0, UNASSIGN in 243 msec 2023-07-17 02:13:37,077 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689560017077"}]},"ts":"1689560017077"} 2023-07-17 02:13:37,079 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-17 02:13:37,080 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-17 02:13:37,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 263 msec 2023-07-17 02:13:37,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 02:13:37,126 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-17 02:13:37,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,132 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,135 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,136 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45215] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,140 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,140 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,140 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,140 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 02:13:37,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 02:13:37,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 02:13:37,141 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,141 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,142 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:37,141 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:37,142 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,142 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:37,142 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 02:13:37,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 02:13:37,150 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:37,152 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:37,152 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/recovered.edits] 2023-07-17 02:13:37,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-17 02:13:37,153 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 02:13:37,155 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/cf, FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/recovered.edits] 2023-07-17 02:13:37,160 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/cf/f2922e4a0ea041e8a02aacf8f741eaf9 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/cf/f2922e4a0ea041e8a02aacf8f741eaf9 2023-07-17 02:13:37,162 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/cf/c007eb11f5824ab79b7923d289743610 to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/cf/c007eb11f5824ab79b7923d289743610 2023-07-17 02:13:37,172 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0/recovered.edits/9.seqid 2023-07-17 02:13:37,173 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5445d768825cc32b2b556994b3a14ea0 2023-07-17 02:13:37,173 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/recovered.edits/9.seqid to hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf/recovered.edits/9.seqid 2023-07-17 02:13:37,174 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9be4a3b73e6be5ec14ac9ec99dfaeadf 2023-07-17 02:13:37,174 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 02:13:37,178 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,180 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-17 02:13:37,191 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-17 02:13:37,194 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,194 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-17 02:13:37,194 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689560017194"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:37,194 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689560017194"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:37,196 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 02:13:37,196 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5445d768825cc32b2b556994b3a14ea0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689559997212.5445d768825cc32b2b556994b3a14ea0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9be4a3b73e6be5ec14ac9ec99dfaeadf, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689559997212.9be4a3b73e6be5ec14ac9ec99dfaeadf.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 02:13:37,196 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-17 02:13:37,197 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689560017197"}]},"ts":"9223372036854775807"} 2023-07-17 02:13:37,199 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-17 02:13:37,207 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 80 msec 2023-07-17 02:13:37,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 02:13:37,244 INFO [Listener at jenkins-hbase4.apache.org/46125] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-17 02:13:37,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 02:13:37,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 02:13:37,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40829] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 02:13:37,295 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 767), OpenFileDescriptor=900 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=611 (was 523) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 181), AvailableMemoryMB=1331 (was 1460) 2023-07-17 02:13:37,295 WARN [Listener at jenkins-hbase4.apache.org/46125] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-17 02:13:37,295 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-17 02:13:37,310 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 02:13:37,429 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689559883575_0007_01_000001 is : 143 2023-07-17 02:13:42,629 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 02:13:51,452 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 02:14:05,583 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 02:14:05,584 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 02:14:05,590 WARN [835064915@qtp-1284196707-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35999] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-17 02:14:05,590 WARN [835064915@qtp-1284196707-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35999] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-17 02:14:05,699 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-17 02:14:05,716 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-17 02:14:05,719 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 02:14:05,752 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 02:14:05,759 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 02:14:05,760 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-17 02:14:05,760 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-17 02:14:05,760 INFO [Listener at jenkins-hbase4.apache.org/46125] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-17 02:14:05,760 DEBUG [Listener at jenkins-hbase4.apache.org/46125] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3abf2aba to 127.0.0.1:62514 2023-07-17 02:14:05,760 DEBUG [Listener at jenkins-hbase4.apache.org/46125] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:14:05,762 DEBUG [Listener at jenkins-hbase4.apache.org/46125] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-17 02:14:05,763 DEBUG [Listener at jenkins-hbase4.apache.org/46125] util.JVMClusterUtil(257): Found active master hash=575097186, stopped=false 2023-07-17 02:14:05,763 DEBUG [Listener at jenkins-hbase4.apache.org/46125] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:14:05,764 DEBUG [Listener at jenkins-hbase4.apache.org/46125] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 02:14:05,764 INFO [Listener at jenkins-hbase4.apache.org/46125] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:14:05,765 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 02:14:05,765 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 02:14:05,765 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 02:14:05,765 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 02:14:05,766 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:14:05,766 INFO [Listener at jenkins-hbase4.apache.org/46125] procedure2.ProcedureExecutor(629): Stopping 2023-07-17 02:14:05,766 DEBUG [Listener at jenkins-hbase4.apache.org/46125] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b2db392 to 127.0.0.1:62514 2023-07-17 02:14:05,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 02:14:05,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 02:14:05,766 DEBUG [Listener at jenkins-hbase4.apache.org/46125] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:14:05,767 INFO [Listener at jenkins-hbase4.apache.org/46125] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37335,1689559874362' ***** 2023-07-17 02:14:05,767 DEBUG [Listener at jenkins-hbase4.apache.org/46125] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:14:05,767 INFO [Listener at jenkins-hbase4.apache.org/46125] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 02:14:05,767 INFO [Listener at jenkins-hbase4.apache.org/46125] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35673,1689559874442' ***** 2023-07-17 02:14:05,768 DEBUG [Listener at jenkins-hbase4.apache.org/46125] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:14:05,768 INFO [RS:0;jenkins-hbase4:37335] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 02:14:05,768 INFO [Listener at jenkins-hbase4.apache.org/46125] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 02:14:05,768 INFO [Listener at jenkins-hbase4.apache.org/46125] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45215,1689559874524' ***** 2023-07-17 02:14:05,768 INFO [RS:1;jenkins-hbase4:35673] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 02:14:05,768 DEBUG [Listener at jenkins-hbase4.apache.org/46125] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:14:05,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 02:14:05,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 02:14:05,768 INFO [Listener at jenkins-hbase4.apache.org/46125] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 02:14:05,768 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 02:14:05,768 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 02:14:05,768 INFO [RS:1;jenkins-hbase4:35673] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 02:14:05,769 INFO [RS:1;jenkins-hbase4:35673] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 02:14:05,769 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:14:05,769 DEBUG [RS:1;jenkins-hbase4:35673] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x014b5c25 to 127.0.0.1:62514 2023-07-17 02:14:05,769 DEBUG [RS:1;jenkins-hbase4:35673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:14:05,768 INFO [RS:0;jenkins-hbase4:37335] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 02:14:05,777 INFO [RS:2;jenkins-hbase4:45215] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 02:14:05,777 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 02:14:05,778 INFO [RS:2;jenkins-hbase4:45215] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 02:14:05,778 INFO [RS:2;jenkins-hbase4:45215] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 02:14:05,778 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(3305): Received CLOSE for e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:14:05,778 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(3305): Received CLOSE for 935ff182eebb818a965f31c5ec08cc00 2023-07-17 02:14:05,778 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:14:05,777 INFO [RS:0;jenkins-hbase4:37335] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 02:14:05,774 INFO [RS:1;jenkins-hbase4:35673] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 02:14:05,779 INFO [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:14:05,779 DEBUG [RS:2;jenkins-hbase4:45215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x748530fb to 127.0.0.1:62514 2023-07-17 02:14:05,779 DEBUG [RS:0;jenkins-hbase4:37335] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x749237b6 to 127.0.0.1:62514 2023-07-17 02:14:05,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e06d40081fa369e1ba41c9bcb4aeabdc, disabling compactions & flushes 2023-07-17 02:14:05,778 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 02:14:05,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:14:05,779 DEBUG [RS:0;jenkins-hbase4:37335] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:14:05,779 DEBUG [RS:2;jenkins-hbase4:45215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:14:05,780 INFO [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37335,1689559874362; all regions closed. 2023-07-17 02:14:05,779 INFO [RS:1;jenkins-hbase4:35673] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 02:14:05,781 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-17 02:14:05,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:14:05,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. after waiting 0 ms 2023-07-17 02:14:05,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:14:05,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e06d40081fa369e1ba41c9bcb4aeabdc 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-17 02:14:05,781 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1478): Online Regions={e06d40081fa369e1ba41c9bcb4aeabdc=hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc., 935ff182eebb818a965f31c5ec08cc00=hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00.} 2023-07-17 02:14:05,781 INFO [RS:1;jenkins-hbase4:35673] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 02:14:05,781 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-17 02:14:05,782 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 02:14:05,782 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-17 02:14:05,782 DEBUG [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-17 02:14:05,782 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1504): Waiting on 935ff182eebb818a965f31c5ec08cc00, e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:14:05,783 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 02:14:05,783 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 02:14:05,783 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 02:14:05,783 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 02:14:05,783 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 02:14:05,783 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-17 02:14:05,796 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 02:14:05,796 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 02:14:05,830 DEBUG [RS:0;jenkins-hbase4:37335] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/oldWALs 2023-07-17 02:14:05,830 INFO [RS:0;jenkins-hbase4:37335] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37335%2C1689559874362:(num 1689559876786) 2023-07-17 02:14:05,830 DEBUG [RS:0;jenkins-hbase4:37335] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:14:05,830 INFO [RS:0;jenkins-hbase4:37335] regionserver.LeaseManager(133): Closed leases 2023-07-17 02:14:05,833 INFO [RS:0;jenkins-hbase4:37335] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 02:14:05,833 INFO [RS:0;jenkins-hbase4:37335] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 02:14:05,833 INFO [RS:0;jenkins-hbase4:37335] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 02:14:05,833 INFO [RS:0;jenkins-hbase4:37335] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 02:14:05,833 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 02:14:05,834 INFO [RS:0;jenkins-hbase4:37335] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37335 2023-07-17 02:14:05,837 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/.tmp/info/8161c58e76f549b4af6e06469b0690b5 2023-07-17 02:14:05,844 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:14:05,844 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 02:14:05,845 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 02:14:05,845 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:14:05,845 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37335,1689559874362 2023-07-17 02:14:05,845 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8161c58e76f549b4af6e06469b0690b5 2023-07-17 02:14:05,845 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 02:14:05,845 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 02:14:05,848 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37335,1689559874362] 2023-07-17 02:14:05,848 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37335,1689559874362; numProcessing=1 2023-07-17 02:14:05,858 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37335,1689559874362 already deleted, retry=false 2023-07-17 02:14:05,859 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37335,1689559874362 expired; onlineServers=2 2023-07-17 02:14:05,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/.tmp/rep_barrier/1e03858f2e474d76bf2aa96faf5e8897 2023-07-17 02:14:05,871 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e03858f2e474d76bf2aa96faf5e8897 2023-07-17 02:14:05,881 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/.tmp/table/4a2bc9f5698840efa6897bd70262d650 2023-07-17 02:14:05,886 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a2bc9f5698840efa6897bd70262d650 2023-07-17 02:14:05,887 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/.tmp/info/8161c58e76f549b4af6e06469b0690b5 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/info/8161c58e76f549b4af6e06469b0690b5 2023-07-17 02:14:05,891 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8161c58e76f549b4af6e06469b0690b5 2023-07-17 02:14:05,892 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/info/8161c58e76f549b4af6e06469b0690b5, entries=48, sequenceid=131, filesize=10.3 K 2023-07-17 02:14:05,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/.tmp/rep_barrier/1e03858f2e474d76bf2aa96faf5e8897 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/rep_barrier/1e03858f2e474d76bf2aa96faf5e8897 2023-07-17 02:14:05,898 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e03858f2e474d76bf2aa96faf5e8897 2023-07-17 02:14:05,899 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/rep_barrier/1e03858f2e474d76bf2aa96faf5e8897, entries=13, sequenceid=131, filesize=6.4 K 2023-07-17 02:14:05,900 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/.tmp/table/4a2bc9f5698840efa6897bd70262d650 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/table/4a2bc9f5698840efa6897bd70262d650 2023-07-17 02:14:05,905 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a2bc9f5698840efa6897bd70262d650 2023-07-17 02:14:05,905 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/table/4a2bc9f5698840efa6897bd70262d650, entries=24, sequenceid=131, filesize=6.9 K 2023-07-17 02:14:05,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 124ms, sequenceid=131, compaction requested=false 2023-07-17 02:14:05,949 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 02:14:05,949 INFO [RS:0;jenkins-hbase4:37335] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37335,1689559874362; zookeeper connection closed. 2023-07-17 02:14:05,949 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:37335-0x101710c34000001, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 02:14:05,949 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4a94c49c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4a94c49c 2023-07-17 02:14:05,971 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-17 02:14:05,972 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:14:05,972 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 02:14:05,973 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 02:14:05,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 02:14:05,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-17 02:14:05,982 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35673,1689559874442; all regions closed. 2023-07-17 02:14:05,982 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1504): Waiting on 935ff182eebb818a965f31c5ec08cc00, e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:14:05,995 DEBUG [RS:1;jenkins-hbase4:35673] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/oldWALs 2023-07-17 02:14:05,995 INFO [RS:1;jenkins-hbase4:35673] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35673%2C1689559874442.meta:.meta(num 1689559876957) 2023-07-17 02:14:06,008 DEBUG [RS:1;jenkins-hbase4:35673] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/oldWALs 2023-07-17 02:14:06,008 INFO [RS:1;jenkins-hbase4:35673] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35673%2C1689559874442:(num 1689559876796) 2023-07-17 02:14:06,008 DEBUG [RS:1;jenkins-hbase4:35673] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:14:06,008 INFO [RS:1;jenkins-hbase4:35673] regionserver.LeaseManager(133): Closed leases 2023-07-17 02:14:06,009 INFO [RS:1;jenkins-hbase4:35673] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-17 02:14:06,009 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 02:14:06,010 INFO [RS:1;jenkins-hbase4:35673] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35673 2023-07-17 02:14:06,012 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 02:14:06,012 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:14:06,012 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35673,1689559874442 2023-07-17 02:14:06,013 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35673,1689559874442] 2023-07-17 02:14:06,013 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35673,1689559874442; numProcessing=2 2023-07-17 02:14:06,014 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35673,1689559874442 already deleted, retry=false 2023-07-17 02:14:06,014 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35673,1689559874442 expired; onlineServers=1 2023-07-17 02:14:06,114 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 02:14:06,114 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:35673-0x101710c34000002, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 02:14:06,114 INFO [RS:1;jenkins-hbase4:35673] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35673,1689559874442; zookeeper connection closed. 2023-07-17 02:14:06,115 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2911a4d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2911a4d 2023-07-17 02:14:06,183 DEBUG [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1504): Waiting on 935ff182eebb818a965f31c5ec08cc00, e06d40081fa369e1ba41c9bcb4aeabdc 2023-07-17 02:14:06,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc/.tmp/info/bf3de801f857426da00cd37ee2fb97f9 2023-07-17 02:14:06,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc/.tmp/info/bf3de801f857426da00cd37ee2fb97f9 as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc/info/bf3de801f857426da00cd37ee2fb97f9 2023-07-17 02:14:06,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc/info/bf3de801f857426da00cd37ee2fb97f9, entries=2, sequenceid=6, filesize=4.8 K 2023-07-17 02:14:06,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e06d40081fa369e1ba41c9bcb4aeabdc in 482ms, sequenceid=6, compaction requested=false 2023-07-17 02:14:06,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/namespace/e06d40081fa369e1ba41c9bcb4aeabdc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 02:14:06,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:14:06,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:14:06,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e06d40081fa369e1ba41c9bcb4aeabdc: 2023-07-17 02:14:06,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689559877346.e06d40081fa369e1ba41c9bcb4aeabdc. 2023-07-17 02:14:06,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 935ff182eebb818a965f31c5ec08cc00, disabling compactions & flushes 2023-07-17 02:14:06,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:14:06,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:14:06,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. after waiting 0 ms 2023-07-17 02:14:06,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:14:06,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 935ff182eebb818a965f31c5ec08cc00 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-17 02:14:06,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00/.tmp/l/d383b7048d6d459dba421e69adac903b 2023-07-17 02:14:06,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d383b7048d6d459dba421e69adac903b 2023-07-17 02:14:06,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00/.tmp/l/d383b7048d6d459dba421e69adac903b as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00/l/d383b7048d6d459dba421e69adac903b 2023-07-17 02:14:06,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d383b7048d6d459dba421e69adac903b 2023-07-17 02:14:06,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00/l/d383b7048d6d459dba421e69adac903b, entries=7, sequenceid=18, filesize=5.2 K 2023-07-17 02:14:06,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 935ff182eebb818a965f31c5ec08cc00 in 40ms, sequenceid=18, compaction requested=false 2023-07-17 02:14:06,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/data/hbase/acl/935ff182eebb818a965f31c5ec08cc00/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-17 02:14:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 02:14:06,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:14:06,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 935ff182eebb818a965f31c5ec08cc00: 2023-07-17 02:14:06,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689559878132.935ff182eebb818a965f31c5ec08cc00. 2023-07-17 02:14:06,383 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45215,1689559874524; all regions closed. 2023-07-17 02:14:06,389 DEBUG [RS:2;jenkins-hbase4:45215] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/oldWALs 2023-07-17 02:14:06,389 INFO [RS:2;jenkins-hbase4:45215] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45215%2C1689559874524:(num 1689559876789) 2023-07-17 02:14:06,389 DEBUG [RS:2;jenkins-hbase4:45215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:14:06,389 INFO [RS:2;jenkins-hbase4:45215] regionserver.LeaseManager(133): Closed leases 2023-07-17 02:14:06,390 INFO [RS:2;jenkins-hbase4:45215] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-17 02:14:06,390 INFO [RS:2;jenkins-hbase4:45215] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 02:14:06,390 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 02:14:06,390 INFO [RS:2;jenkins-hbase4:45215] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 02:14:06,390 INFO [RS:2;jenkins-hbase4:45215] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 02:14:06,391 INFO [RS:2;jenkins-hbase4:45215] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45215 2023-07-17 02:14:06,393 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 02:14:06,393 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45215,1689559874524 2023-07-17 02:14:06,395 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45215,1689559874524] 2023-07-17 02:14:06,395 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45215,1689559874524; numProcessing=3 2023-07-17 02:14:06,396 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45215,1689559874524 already deleted, retry=false 2023-07-17 02:14:06,396 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45215,1689559874524 expired; onlineServers=0 2023-07-17 02:14:06,396 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40829,1689559872752' ***** 2023-07-17 02:14:06,396 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-17 02:14:06,396 DEBUG [M:0;jenkins-hbase4:40829] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@637a4359, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 02:14:06,396 INFO [M:0;jenkins-hbase4:40829] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40829,1689559872752 2023-07-17 02:14:06,396 INFO [M:0;jenkins-hbase4:40829] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40829,1689559872752; all regions closed. 2023-07-17 02:14:06,396 DEBUG [M:0;jenkins-hbase4:40829] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 02:14:06,396 DEBUG [M:0;jenkins-hbase4:40829] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-17 02:14:06,397 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-17 02:14:06,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689559876242] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689559876242,5,FailOnTimeoutGroup] 2023-07-17 02:14:06,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689559876246] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689559876246,5,FailOnTimeoutGroup] 2023-07-17 02:14:06,397 DEBUG [M:0;jenkins-hbase4:40829] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-17 02:14:06,397 INFO [M:0;jenkins-hbase4:40829] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-17 02:14:06,397 INFO [M:0;jenkins-hbase4:40829] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-17 02:14:06,397 INFO [M:0;jenkins-hbase4:40829] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-17 02:14:06,397 DEBUG [M:0;jenkins-hbase4:40829] master.HMaster(1512): Stopping service threads 2023-07-17 02:14:06,397 INFO [M:0;jenkins-hbase4:40829] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-17 02:14:06,397 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-17 02:14:06,397 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 02:14:06,398 ERROR [M:0;jenkins-hbase4:40829] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-17 02:14:06,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 02:14:06,398 INFO [M:0;jenkins-hbase4:40829] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-17 02:14:06,398 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-17 02:14:06,399 DEBUG [M:0;jenkins-hbase4:40829] zookeeper.ZKUtil(398): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-17 02:14:06,399 WARN [M:0;jenkins-hbase4:40829] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-17 02:14:06,399 INFO [M:0;jenkins-hbase4:40829] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-17 02:14:06,399 INFO [M:0;jenkins-hbase4:40829] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-17 02:14:06,401 DEBUG [M:0;jenkins-hbase4:40829] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 02:14:06,401 INFO [M:0;jenkins-hbase4:40829] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 02:14:06,401 DEBUG [M:0;jenkins-hbase4:40829] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 02:14:06,401 DEBUG [M:0;jenkins-hbase4:40829] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 02:14:06,401 DEBUG [M:0;jenkins-hbase4:40829] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 02:14:06,401 INFO [M:0;jenkins-hbase4:40829] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.11 KB heapSize=449.26 KB 2023-07-17 02:14:06,416 INFO [M:0;jenkins-hbase4:40829] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.11 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a83a15d270e14e59b9720f432e17542d 2023-07-17 02:14:06,421 INFO [M:0;jenkins-hbase4:40829] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a83a15d270e14e59b9720f432e17542d 2023-07-17 02:14:06,423 DEBUG [M:0;jenkins-hbase4:40829] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a83a15d270e14e59b9720f432e17542d as hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a83a15d270e14e59b9720f432e17542d 2023-07-17 02:14:06,429 INFO [M:0;jenkins-hbase4:40829] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a83a15d270e14e59b9720f432e17542d 2023-07-17 02:14:06,429 INFO [M:0;jenkins-hbase4:40829] regionserver.HStore(1080): Added hdfs://localhost:39797/user/jenkins/test-data/734516c5-65db-9dab-013f-b90e3ea815c1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a83a15d270e14e59b9720f432e17542d, entries=119, sequenceid=899, filesize=28.4 K 2023-07-17 02:14:06,430 INFO [M:0;jenkins-hbase4:40829] regionserver.HRegion(2948): Finished flush of dataSize ~373.11 KB/382067, heapSize ~449.24 KB/460024, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=899, compaction requested=false 2023-07-17 02:14:06,435 INFO [M:0;jenkins-hbase4:40829] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 02:14:06,435 DEBUG [M:0;jenkins-hbase4:40829] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 02:14:06,441 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 02:14:06,441 INFO [M:0;jenkins-hbase4:40829] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-17 02:14:06,442 INFO [M:0;jenkins-hbase4:40829] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40829 2023-07-17 02:14:06,448 DEBUG [M:0;jenkins-hbase4:40829] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40829,1689559872752 already deleted, retry=false 2023-07-17 02:14:06,495 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 02:14:06,495 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): regionserver:45215-0x101710c34000003, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 02:14:06,495 INFO [RS:2;jenkins-hbase4:45215] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45215,1689559874524; zookeeper connection closed. 2023-07-17 02:14:06,496 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@30a1f27e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@30a1f27e 2023-07-17 02:14:06,496 INFO [Listener at jenkins-hbase4.apache.org/46125] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-17 02:14:06,595 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 02:14:06,595 INFO [M:0;jenkins-hbase4:40829] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40829,1689559872752; zookeeper connection closed. 2023-07-17 02:14:06,596 DEBUG [Listener at localhost/37735-EventThread] zookeeper.ZKWatcher(600): master:40829-0x101710c34000000, quorum=127.0.0.1:62514, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 02:14:06,598 WARN [Listener at jenkins-hbase4.apache.org/46125] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 02:14:06,610 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 02:14:06,714 WARN [BP-926520891-172.31.14.131-1689559868106 heartbeating to localhost/127.0.0.1:39797] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 02:14:06,714 WARN [BP-926520891-172.31.14.131-1689559868106 heartbeating to localhost/127.0.0.1:39797] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-926520891-172.31.14.131-1689559868106 (Datanode Uuid cc15a7be-f64b-4d2b-9da3-d815580ae8fe) service to localhost/127.0.0.1:39797 2023-07-17 02:14:06,716 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data5/current/BP-926520891-172.31.14.131-1689559868106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 02:14:06,716 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data6/current/BP-926520891-172.31.14.131-1689559868106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 02:14:06,718 WARN [Listener at jenkins-hbase4.apache.org/46125] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 02:14:06,721 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 02:14:06,826 WARN [BP-926520891-172.31.14.131-1689559868106 heartbeating to localhost/127.0.0.1:39797] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 02:14:06,826 WARN [BP-926520891-172.31.14.131-1689559868106 heartbeating to localhost/127.0.0.1:39797] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-926520891-172.31.14.131-1689559868106 (Datanode Uuid c751f552-7b8f-4600-b432-03bf33f7049a) service to localhost/127.0.0.1:39797 2023-07-17 02:14:06,827 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data3/current/BP-926520891-172.31.14.131-1689559868106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 02:14:06,827 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data4/current/BP-926520891-172.31.14.131-1689559868106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 02:14:06,828 WARN [Listener at jenkins-hbase4.apache.org/46125] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 02:14:06,871 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 02:14:06,975 WARN [BP-926520891-172.31.14.131-1689559868106 heartbeating to localhost/127.0.0.1:39797] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 02:14:06,975 WARN [BP-926520891-172.31.14.131-1689559868106 heartbeating to localhost/127.0.0.1:39797] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-926520891-172.31.14.131-1689559868106 (Datanode Uuid 8fe82f18-0362-49c7-9100-7f91aeaad1b2) service to localhost/127.0.0.1:39797 2023-07-17 02:14:06,976 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data1/current/BP-926520891-172.31.14.131-1689559868106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 02:14:06,976 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5be4db93-1e9e-a745-1e1b-a985a5e7674f/cluster_d11c9f75-781a-730e-bd82-5eb856c91e02/dfs/data/data2/current/BP-926520891-172.31.14.131-1689559868106] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 02:14:06,999 INFO [Listener at jenkins-hbase4.apache.org/46125] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 02:14:07,125 INFO [Listener at jenkins-hbase4.apache.org/46125] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-17 02:14:07,214 INFO [Listener at jenkins-hbase4.apache.org/46125] hbase.HBaseTestingUtility(1293): Minicluster is down