2023-07-21 05:09:51,820 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-21 05:09:52,089 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12 2023-07-21 05:09:52,090 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-21 05:09:52,090 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-21 05:09:52,131 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-21 05:09:52,424 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-21 05:09:52,425 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e, deleteOnExit=true 2023-07-21 05:09:52,425 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-21 05:09:52,426 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/test.cache.data in system properties and HBase conf 2023-07-21 05:09:52,426 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 05:09:52,427 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop.log.dir in system properties and HBase conf 2023-07-21 05:09:52,427 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 05:09:52,428 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 05:09:52,428 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 05:09:52,781 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-21 05:09:52,787 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 05:09:52,787 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 05:09:52,787 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 05:09:52,788 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 05:09:52,788 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 05:09:52,789 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 05:09:52,789 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 05:09:52,789 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 05:09:52,790 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 05:09:52,790 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/nfs.dump.dir in system properties and HBase conf 2023-07-21 05:09:52,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir in system properties and HBase conf 2023-07-21 05:09:52,791 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 05:09:52,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 05:09:52,792 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-21 05:09:53,495 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 05:09:53,500 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 05:09:53,844 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-21 05:09:54,057 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-21 05:09:54,074 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:09:54,123 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:09:54,179 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir/Jetty_localhost_43333_hdfs____4fty1q/webapp 2023-07-21 05:09:54,374 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43333 2023-07-21 05:09:54,390 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-21 05:09:54,390 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-21 05:09:55,011 WARN [Listener at localhost/40289] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 05:09:55,122 WARN [Listener at localhost/40289] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 05:09:55,154 WARN [Listener at localhost/40289] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:09:55,217 INFO [Listener at localhost/40289] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:09:55,224 INFO [Listener at localhost/40289] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir/Jetty_localhost_37453_datanode____.oz7ui3/webapp 2023-07-21 05:09:55,335 INFO [Listener at localhost/40289] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37453 2023-07-21 05:09:55,815 WARN [Listener at localhost/44129] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 05:09:55,845 WARN [Listener at localhost/44129] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 05:09:55,851 WARN [Listener at localhost/44129] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:09:55,853 INFO [Listener at localhost/44129] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:09:55,863 INFO [Listener at localhost/44129] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir/Jetty_localhost_45039_datanode____.qst0kk/webapp 2023-07-21 05:09:56,002 INFO [Listener at localhost/44129] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45039 2023-07-21 05:09:56,023 WARN [Listener at localhost/36939] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 05:09:56,086 WARN [Listener at localhost/36939] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-21 05:09:56,091 WARN [Listener at localhost/36939] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:09:56,092 INFO [Listener at localhost/36939] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:09:56,107 INFO [Listener at localhost/36939] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir/Jetty_localhost_33389_datanode____p2pyz/webapp 2023-07-21 05:09:56,254 INFO [Listener at localhost/36939] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33389 2023-07-21 05:09:56,275 WARN [Listener at localhost/40309] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-21 05:09:56,616 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3bd49cc9f070b9d3: Processing first storage report for DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad from datanode 40257d29-2b5e-42b9-a52f-17518c4eec96 2023-07-21 05:09:56,619 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3bd49cc9f070b9d3: from storage DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad node DatanodeRegistration(127.0.0.1:45705, datanodeUuid=40257d29-2b5e-42b9-a52f-17518c4eec96, infoPort=35163, infoSecurePort=0, ipcPort=40309, storageInfo=lv=-57;cid=testClusterID;nsid=468700669;c=1689916193600), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,619 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xceb553ee50cc4da: Processing first storage report for DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360 from datanode dcc11696-10a7-4b0a-a4d1-8ac0131f6316 2023-07-21 05:09:56,619 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xceb553ee50cc4da: from storage DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360 node DatanodeRegistration(127.0.0.1:43037, datanodeUuid=dcc11696-10a7-4b0a-a4d1-8ac0131f6316, infoPort=34397, infoSecurePort=0, ipcPort=44129, storageInfo=lv=-57;cid=testClusterID;nsid=468700669;c=1689916193600), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,620 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbebdb0ee9b5da5d4: Processing first storage report for DS-299974bb-c42b-4bd2-a161-37dfeb509a44 from datanode bf22acaf-65ad-4566-ab10-8eb2c2aab280 2023-07-21 05:09:56,620 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbebdb0ee9b5da5d4: from storage DS-299974bb-c42b-4bd2-a161-37dfeb509a44 node DatanodeRegistration(127.0.0.1:36953, datanodeUuid=bf22acaf-65ad-4566-ab10-8eb2c2aab280, infoPort=38593, infoSecurePort=0, ipcPort=36939, storageInfo=lv=-57;cid=testClusterID;nsid=468700669;c=1689916193600), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,620 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3bd49cc9f070b9d3: Processing first storage report for DS-c4634d86-31ad-4a73-8485-9297eb672344 from datanode 40257d29-2b5e-42b9-a52f-17518c4eec96 2023-07-21 05:09:56,620 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3bd49cc9f070b9d3: from storage DS-c4634d86-31ad-4a73-8485-9297eb672344 node DatanodeRegistration(127.0.0.1:45705, datanodeUuid=40257d29-2b5e-42b9-a52f-17518c4eec96, infoPort=35163, infoSecurePort=0, ipcPort=40309, storageInfo=lv=-57;cid=testClusterID;nsid=468700669;c=1689916193600), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,620 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xceb553ee50cc4da: Processing first storage report for DS-6d78932e-81e8-4fc6-9168-8b617e351f65 from datanode dcc11696-10a7-4b0a-a4d1-8ac0131f6316 2023-07-21 05:09:56,621 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xceb553ee50cc4da: from storage DS-6d78932e-81e8-4fc6-9168-8b617e351f65 node DatanodeRegistration(127.0.0.1:43037, datanodeUuid=dcc11696-10a7-4b0a-a4d1-8ac0131f6316, infoPort=34397, infoSecurePort=0, ipcPort=44129, storageInfo=lv=-57;cid=testClusterID;nsid=468700669;c=1689916193600), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,621 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbebdb0ee9b5da5d4: Processing first storage report for DS-1ece9f44-29be-4441-b305-3235f5270f7d from datanode bf22acaf-65ad-4566-ab10-8eb2c2aab280 2023-07-21 05:09:56,621 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbebdb0ee9b5da5d4: from storage DS-1ece9f44-29be-4441-b305-3235f5270f7d node DatanodeRegistration(127.0.0.1:36953, datanodeUuid=bf22acaf-65ad-4566-ab10-8eb2c2aab280, infoPort=38593, infoSecurePort=0, ipcPort=36939, storageInfo=lv=-57;cid=testClusterID;nsid=468700669;c=1689916193600), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-21 05:09:56,880 DEBUG [Listener at localhost/40309] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12 2023-07-21 05:09:56,976 INFO [Listener at localhost/40309] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/zookeeper_0, clientPort=51418, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-21 05:09:57,003 INFO [Listener at localhost/40309] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51418 2023-07-21 05:09:57,015 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:57,018 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:57,755 INFO [Listener at localhost/40309] util.FSUtils(471): Created version file at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 with version=8 2023-07-21 05:09:57,755 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/hbase-staging 2023-07-21 05:09:58,106 INFO [Listener at localhost/40309] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-21 05:09:58,678 INFO [Listener at localhost/40309] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 05:09:58,713 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:58,714 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:58,714 INFO [Listener at localhost/40309] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 05:09:58,714 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:58,714 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 05:09:58,884 INFO [Listener at localhost/40309] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 05:09:58,966 DEBUG [Listener at localhost/40309] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-21 05:09:59,087 INFO [Listener at localhost/40309] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44111 2023-07-21 05:09:59,102 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,104 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,128 INFO [Listener at localhost/40309] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44111 connecting to ZooKeeper ensemble=127.0.0.1:51418 2023-07-21 05:09:59,205 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:441110x0, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 05:09:59,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44111-0x10186494b5a0000 connected 2023-07-21 05:09:59,265 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:09:59,266 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:09:59,280 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 05:09:59,297 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44111 2023-07-21 05:09:59,298 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44111 2023-07-21 05:09:59,303 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44111 2023-07-21 05:09:59,306 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44111 2023-07-21 05:09:59,306 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44111 2023-07-21 05:09:59,313 INFO [Listener at localhost/40309] master.HMaster(444): hbase.rootdir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13, hbase.cluster.distributed=false 2023-07-21 05:09:59,402 INFO [Listener at localhost/40309] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 05:09:59,403 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,403 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,403 INFO [Listener at localhost/40309] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 05:09:59,403 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,403 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 05:09:59,409 INFO [Listener at localhost/40309] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 05:09:59,413 INFO [Listener at localhost/40309] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42011 2023-07-21 05:09:59,416 INFO [Listener at localhost/40309] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 05:09:59,423 INFO [Listener at localhost/40309] mob.MobFileCache(124): MobFileCache disabled 2023-07-21 05:09:59,424 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,426 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,429 INFO [Listener at localhost/40309] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42011 connecting to ZooKeeper ensemble=127.0.0.1:51418 2023-07-21 05:09:59,437 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:420110x0, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 05:09:59,438 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): regionserver:420110x0, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:09:59,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42011-0x10186494b5a0001 connected 2023-07-21 05:09:59,440 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:09:59,441 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 05:09:59,442 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42011 2023-07-21 05:09:59,442 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42011 2023-07-21 05:09:59,442 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42011 2023-07-21 05:09:59,446 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42011 2023-07-21 05:09:59,446 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42011 2023-07-21 05:09:59,459 INFO [Listener at localhost/40309] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 05:09:59,460 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,460 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,460 INFO [Listener at localhost/40309] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 05:09:59,461 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,461 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 05:09:59,461 INFO [Listener at localhost/40309] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 05:09:59,463 INFO [Listener at localhost/40309] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34259 2023-07-21 05:09:59,463 INFO [Listener at localhost/40309] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 05:09:59,465 INFO [Listener at localhost/40309] mob.MobFileCache(124): MobFileCache disabled 2023-07-21 05:09:59,465 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,471 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,473 INFO [Listener at localhost/40309] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34259 connecting to ZooKeeper ensemble=127.0.0.1:51418 2023-07-21 05:09:59,477 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:342590x0, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 05:09:59,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34259-0x10186494b5a0002 connected 2023-07-21 05:09:59,479 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:09:59,480 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:09:59,481 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 05:09:59,481 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34259 2023-07-21 05:09:59,482 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34259 2023-07-21 05:09:59,487 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34259 2023-07-21 05:09:59,487 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34259 2023-07-21 05:09:59,487 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34259 2023-07-21 05:09:59,499 INFO [Listener at localhost/40309] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-21 05:09:59,500 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,500 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,500 INFO [Listener at localhost/40309] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-21 05:09:59,500 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-21 05:09:59,500 INFO [Listener at localhost/40309] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-21 05:09:59,500 INFO [Listener at localhost/40309] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-21 05:09:59,503 INFO [Listener at localhost/40309] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41899 2023-07-21 05:09:59,503 INFO [Listener at localhost/40309] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-21 05:09:59,504 INFO [Listener at localhost/40309] mob.MobFileCache(124): MobFileCache disabled 2023-07-21 05:09:59,505 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,506 INFO [Listener at localhost/40309] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,508 INFO [Listener at localhost/40309] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41899 connecting to ZooKeeper ensemble=127.0.0.1:51418 2023-07-21 05:09:59,512 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:418990x0, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-21 05:09:59,513 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): regionserver:418990x0, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:09:59,514 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): regionserver:418990x0, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:09:59,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41899-0x10186494b5a0003 connected 2023-07-21 05:09:59,515 DEBUG [Listener at localhost/40309] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-21 05:09:59,519 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41899 2023-07-21 05:09:59,519 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41899 2023-07-21 05:09:59,521 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41899 2023-07-21 05:09:59,522 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41899 2023-07-21 05:09:59,522 DEBUG [Listener at localhost/40309] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41899 2023-07-21 05:09:59,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:09:59,539 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 05:09:59,542 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:09:59,569 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 05:09:59,569 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 05:09:59,569 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 05:09:59,569 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:09:59,569 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-21 05:09:59,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 05:09:59,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-21 05:09:59,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44111,1689916197930 from backup master directory 2023-07-21 05:09:59,578 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:09:59,578 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-21 05:09:59,579 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 05:09:59,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:09:59,583 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-21 05:09:59,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-21 05:09:59,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/hbase.id with ID: d0936ce8-b65f-4ff4-89f4-8a444ef0d8e1 2023-07-21 05:09:59,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-21 05:09:59,805 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:09:59,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x06ecf4b9 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:09:59,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@101dd6e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:09:59,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:09:59,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-21 05:09:59,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-21 05:09:59,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-21 05:09:59,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 05:09:59,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-21 05:09:59,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:10:00,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/data/master/store-tmp 2023-07-21 05:10:00,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:00,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 05:10:00,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:10:00,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:10:00,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 05:10:00,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:10:00,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:10:00,127 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 05:10:00,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/WALs/jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:10:00,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44111%2C1689916197930, suffix=, logDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/WALs/jenkins-hbase4.apache.org,44111,1689916197930, archiveDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/oldWALs, maxLogs=10 2023-07-21 05:10:00,236 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK] 2023-07-21 05:10:00,236 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK] 2023-07-21 05:10:00,236 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK] 2023-07-21 05:10:00,244 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-21 05:10:00,335 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/WALs/jenkins-hbase4.apache.org,44111,1689916197930/jenkins-hbase4.apache.org%2C44111%2C1689916197930.1689916200172 2023-07-21 05:10:00,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK], DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK]] 2023-07-21 05:10:00,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:10:00,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:00,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,417 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,427 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-21 05:10:00,455 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-21 05:10:00,468 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:00,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,477 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,493 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-21 05:10:00,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:00,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65821030, jitterRate=-0.019190222024917603}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:00,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 05:10:00,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-21 05:10:00,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-21 05:10:00,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-21 05:10:00,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-21 05:10:00,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-21 05:10:00,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 48 msec 2023-07-21 05:10:00,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-21 05:10:00,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-21 05:10:00,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-21 05:10:00,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-21 05:10:00,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-21 05:10:00,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-21 05:10:00,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-21 05:10:00,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-21 05:10:00,706 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:00,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-21 05:10:00,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-21 05:10:00,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-21 05:10:00,749 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 05:10:00,749 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 05:10:00,749 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:00,749 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 05:10:00,749 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-21 05:10:00,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44111,1689916197930, sessionid=0x10186494b5a0000, setting cluster-up flag (Was=false) 2023-07-21 05:10:00,776 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:00,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-21 05:10:00,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:10:00,807 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:00,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-21 05:10:00,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:10:00,819 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp 2023-07-21 05:10:00,833 INFO [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(951): ClusterId : d0936ce8-b65f-4ff4-89f4-8a444ef0d8e1 2023-07-21 05:10:00,837 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(951): ClusterId : d0936ce8-b65f-4ff4-89f4-8a444ef0d8e1 2023-07-21 05:10:00,866 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(951): ClusterId : d0936ce8-b65f-4ff4-89f4-8a444ef0d8e1 2023-07-21 05:10:00,870 DEBUG [RS:0;jenkins-hbase4:42011] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 05:10:00,870 DEBUG [RS:2;jenkins-hbase4:41899] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 05:10:00,870 DEBUG [RS:1;jenkins-hbase4:34259] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-21 05:10:00,886 DEBUG [RS:0;jenkins-hbase4:42011] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 05:10:00,886 DEBUG [RS:2;jenkins-hbase4:41899] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 05:10:00,886 DEBUG [RS:1;jenkins-hbase4:34259] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-21 05:10:00,887 DEBUG [RS:2;jenkins-hbase4:41899] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 05:10:00,886 DEBUG [RS:0;jenkins-hbase4:42011] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 05:10:00,887 DEBUG [RS:1;jenkins-hbase4:34259] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-21 05:10:00,900 DEBUG [RS:2;jenkins-hbase4:41899] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 05:10:00,900 DEBUG [RS:1;jenkins-hbase4:34259] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 05:10:00,900 DEBUG [RS:0;jenkins-hbase4:42011] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-21 05:10:00,903 DEBUG [RS:2;jenkins-hbase4:41899] zookeeper.ReadOnlyZKClient(139): Connect 0x280df3d3 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:00,903 DEBUG [RS:0;jenkins-hbase4:42011] zookeeper.ReadOnlyZKClient(139): Connect 0x014c910c to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:00,903 DEBUG [RS:1;jenkins-hbase4:34259] zookeeper.ReadOnlyZKClient(139): Connect 0x73138f78 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:00,926 DEBUG [RS:2;jenkins-hbase4:41899] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26ca08a2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:00,927 DEBUG [RS:0;jenkins-hbase4:42011] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f8b7f55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:00,927 DEBUG [RS:2;jenkins-hbase4:41899] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22f598a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 05:10:00,927 DEBUG [RS:0;jenkins-hbase4:42011] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bb4fa7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 05:10:00,958 DEBUG [RS:1;jenkins-hbase4:34259] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dd47f6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:00,959 DEBUG [RS:1;jenkins-hbase4:34259] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79ebe408, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 05:10:00,988 DEBUG [RS:0;jenkins-hbase4:42011] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42011 2023-07-21 05:10:00,989 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:41899 2023-07-21 05:10:00,994 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34259 2023-07-21 05:10:00,997 INFO [RS:1;jenkins-hbase4:34259] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 05:10:00,998 INFO [RS:1;jenkins-hbase4:34259] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 05:10:00,999 INFO [RS:0;jenkins-hbase4:42011] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 05:10:00,999 INFO [RS:0;jenkins-hbase4:42011] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 05:10:01,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-21 05:10:00,998 INFO [RS:2;jenkins-hbase4:41899] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-21 05:10:01,002 INFO [RS:2;jenkins-hbase4:41899] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-21 05:10:01,009 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 05:10:01,009 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 05:10:01,009 DEBUG [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-21 05:10:01,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:01,012 INFO [RS:2;jenkins-hbase4:41899] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:01,012 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 05:10:01,012 INFO [RS:0;jenkins-hbase4:42011] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:01,012 DEBUG [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 05:10:01,011 INFO [RS:1;jenkins-hbase4:34259] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:01,012 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1022): About to register with Master. 2023-07-21 05:10:01,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-21 05:10:01,018 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44111,1689916197930 with isa=jenkins-hbase4.apache.org/172.31.14.131:34259, startcode=1689916199459 2023-07-21 05:10:01,022 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44111,1689916197930 with isa=jenkins-hbase4.apache.org/172.31.14.131:41899, startcode=1689916199499 2023-07-21 05:10:01,023 INFO [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44111,1689916197930 with isa=jenkins-hbase4.apache.org/172.31.14.131:42011, startcode=1689916199401 2023-07-21 05:10:01,040 DEBUG [RS:2;jenkins-hbase4:41899] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 05:10:01,040 DEBUG [RS:1;jenkins-hbase4:34259] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 05:10:01,041 DEBUG [RS:0;jenkins-hbase4:42011] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-21 05:10:01,121 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54829, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 05:10:01,121 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41057, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 05:10:01,121 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44081, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-21 05:10:01,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-21 05:10:01,131 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44111] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 05:10:01,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 05:10:01,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 05:10:01,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 05:10:01,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-21 05:10:01,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-21 05:10:01,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 05:10:01,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689916231139 2023-07-21 05:10:01,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-21 05:10:01,143 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44111] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 05:10:01,143 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44111] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-21 05:10:01,149 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 05:10:01,151 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-21 05:10:01,158 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 05:10:01,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-21 05:10:01,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-21 05:10:01,171 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 05:10:01,172 DEBUG [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 05:10:01,172 WARN [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 05:10:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-21 05:10:01,172 WARN [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 05:10:01,171 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(2830): Master is not running yet 2023-07-21 05:10:01,172 WARN [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-21 05:10:01,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-21 05:10:01,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-21 05:10:01,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-21 05:10:01,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-21 05:10:01,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-21 05:10:01,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-21 05:10:01,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-21 05:10:01,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689916201184,5,FailOnTimeoutGroup] 2023-07-21 05:10:01,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689916201200,5,FailOnTimeoutGroup] 2023-07-21 05:10:01,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-21 05:10:01,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,204 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,262 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:01,264 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:01,264 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:01,273 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44111,1689916197930 with isa=jenkins-hbase4.apache.org/172.31.14.131:41899, startcode=1689916199499 2023-07-21 05:10:01,273 INFO [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44111,1689916197930 with isa=jenkins-hbase4.apache.org/172.31.14.131:42011, startcode=1689916199401 2023-07-21 05:10:01,273 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44111,1689916197930 with isa=jenkins-hbase4.apache.org/172.31.14.131:34259, startcode=1689916199459 2023-07-21 05:10:01,293 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44111] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:01,300 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44111] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:01,304 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44111] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:01,305 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:01,310 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40289 2023-07-21 05:10:01,310 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 05:10:01,309 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:01,315 DEBUG [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:01,316 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40289 2023-07-21 05:10:01,316 DEBUG [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40289 2023-07-21 05:10:01,317 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 05:10:01,318 DEBUG [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-21 05:10:01,319 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:10:01,328 DEBUG [RS:2;jenkins-hbase4:41899] zookeeper.ZKUtil(162): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:01,329 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34259,1689916199459] 2023-07-21 05:10:01,329 WARN [RS:2;jenkins-hbase4:41899] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 05:10:01,332 INFO [RS:2;jenkins-hbase4:41899] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:10:01,332 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:01,333 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:01,329 DEBUG [RS:1;jenkins-hbase4:34259] zookeeper.ZKUtil(162): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:01,329 DEBUG [RS:0;jenkins-hbase4:42011] zookeeper.ZKUtil(162): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:01,332 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42011,1689916199401] 2023-07-21 05:10:01,334 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41899,1689916199499] 2023-07-21 05:10:01,333 WARN [RS:1;jenkins-hbase4:34259] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 05:10:01,333 WARN [RS:0;jenkins-hbase4:42011] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-21 05:10:01,340 INFO [RS:1;jenkins-hbase4:34259] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:10:01,340 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 05:10:01,341 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:01,340 INFO [RS:0;jenkins-hbase4:42011] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:10:01,341 DEBUG [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:01,349 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/info 2023-07-21 05:10:01,350 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 05:10:01,352 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,353 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 05:10:01,357 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/rep_barrier 2023-07-21 05:10:01,357 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 05:10:01,359 DEBUG [RS:2;jenkins-hbase4:41899] zookeeper.ZKUtil(162): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:01,359 DEBUG [RS:0;jenkins-hbase4:42011] zookeeper.ZKUtil(162): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:01,359 DEBUG [RS:1;jenkins-hbase4:34259] zookeeper.ZKUtil(162): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:01,360 DEBUG [RS:2;jenkins-hbase4:41899] zookeeper.ZKUtil(162): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:01,360 DEBUG [RS:0;jenkins-hbase4:42011] zookeeper.ZKUtil(162): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:01,360 DEBUG [RS:1;jenkins-hbase4:34259] zookeeper.ZKUtil(162): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:01,361 DEBUG [RS:2;jenkins-hbase4:41899] zookeeper.ZKUtil(162): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:01,359 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,361 DEBUG [RS:1;jenkins-hbase4:34259] zookeeper.ZKUtil(162): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:01,361 DEBUG [RS:0;jenkins-hbase4:42011] zookeeper.ZKUtil(162): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:01,363 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 05:10:01,365 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/table 2023-07-21 05:10:01,366 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 05:10:01,367 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,368 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740 2023-07-21 05:10:01,375 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740 2023-07-21 05:10:01,388 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 05:10:01,391 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 05:10:01,391 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 05:10:01,395 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 05:10:01,396 DEBUG [RS:0;jenkins-hbase4:42011] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-21 05:10:01,406 INFO [RS:0;jenkins-hbase4:42011] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 05:10:01,406 INFO [RS:2;jenkins-hbase4:41899] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 05:10:01,410 INFO [RS:1;jenkins-hbase4:34259] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-21 05:10:01,421 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:01,422 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75014608, jitterRate=0.11780476570129395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 05:10:01,422 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 05:10:01,422 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 05:10:01,422 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 05:10:01,423 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 05:10:01,423 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 05:10:01,423 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 05:10:01,427 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 05:10:01,427 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 05:10:01,444 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-21 05:10:01,444 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-21 05:10:01,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-21 05:10:01,468 INFO [RS:1;jenkins-hbase4:34259] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 05:10:01,468 INFO [RS:0;jenkins-hbase4:42011] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 05:10:01,468 INFO [RS:2;jenkins-hbase4:41899] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-21 05:10:01,474 INFO [RS:1;jenkins-hbase4:34259] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 05:10:01,474 INFO [RS:2;jenkins-hbase4:41899] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 05:10:01,475 INFO [RS:1;jenkins-hbase4:34259] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,474 INFO [RS:0;jenkins-hbase4:42011] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-21 05:10:01,475 INFO [RS:2;jenkins-hbase4:41899] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,479 INFO [RS:0;jenkins-hbase4:42011] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,480 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 05:10:01,482 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 05:10:01,486 INFO [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-21 05:10:01,487 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-21 05:10:01,494 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-21 05:10:01,498 INFO [RS:0;jenkins-hbase4:42011] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,498 INFO [RS:1;jenkins-hbase4:34259] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,498 INFO [RS:2;jenkins-hbase4:41899] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,499 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,499 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,499 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,503 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,503 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,503 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 05:10:01,503 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,503 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,502 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 05:10:01,503 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,504 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,504 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-21 05:10:01,504 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,504 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,504 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,504 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,504 DEBUG [RS:0;jenkins-hbase4:42011] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,504 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,504 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,504 DEBUG [RS:1;jenkins-hbase4:34259] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,505 DEBUG [RS:2;jenkins-hbase4:41899] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-21 05:10:01,507 INFO [RS:1;jenkins-hbase4:34259] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,508 INFO [RS:1;jenkins-hbase4:34259] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,508 INFO [RS:1;jenkins-hbase4:34259] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,512 INFO [RS:0;jenkins-hbase4:42011] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,512 INFO [RS:2;jenkins-hbase4:41899] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,512 INFO [RS:0;jenkins-hbase4:42011] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,512 INFO [RS:2;jenkins-hbase4:41899] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,512 INFO [RS:0;jenkins-hbase4:42011] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,512 INFO [RS:2;jenkins-hbase4:41899] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,527 INFO [RS:1;jenkins-hbase4:34259] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 05:10:01,531 INFO [RS:0;jenkins-hbase4:42011] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 05:10:01,532 INFO [RS:1;jenkins-hbase4:34259] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34259,1689916199459-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,532 INFO [RS:0;jenkins-hbase4:42011] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42011,1689916199401-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,532 INFO [RS:2;jenkins-hbase4:41899] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-21 05:10:01,532 INFO [RS:2;jenkins-hbase4:41899] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41899,1689916199499-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:01,563 INFO [RS:1;jenkins-hbase4:34259] regionserver.Replication(203): jenkins-hbase4.apache.org,34259,1689916199459 started 2023-07-21 05:10:01,564 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34259,1689916199459, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34259, sessionid=0x10186494b5a0002 2023-07-21 05:10:01,566 INFO [RS:0;jenkins-hbase4:42011] regionserver.Replication(203): jenkins-hbase4.apache.org,42011,1689916199401 started 2023-07-21 05:10:01,566 INFO [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42011,1689916199401, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42011, sessionid=0x10186494b5a0001 2023-07-21 05:10:01,566 INFO [RS:2;jenkins-hbase4:41899] regionserver.Replication(203): jenkins-hbase4.apache.org,41899,1689916199499 started 2023-07-21 05:10:01,566 DEBUG [RS:0;jenkins-hbase4:42011] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 05:10:01,566 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41899,1689916199499, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41899, sessionid=0x10186494b5a0003 2023-07-21 05:10:01,566 DEBUG [RS:0;jenkins-hbase4:42011] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:01,566 DEBUG [RS:2;jenkins-hbase4:41899] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 05:10:01,566 DEBUG [RS:1;jenkins-hbase4:34259] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-21 05:10:01,566 DEBUG [RS:2;jenkins-hbase4:41899] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:01,566 DEBUG [RS:0;jenkins-hbase4:42011] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42011,1689916199401' 2023-07-21 05:10:01,567 DEBUG [RS:2;jenkins-hbase4:41899] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41899,1689916199499' 2023-07-21 05:10:01,568 DEBUG [RS:2;jenkins-hbase4:41899] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 05:10:01,567 DEBUG [RS:1;jenkins-hbase4:34259] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:01,568 DEBUG [RS:0;jenkins-hbase4:42011] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 05:10:01,568 DEBUG [RS:1;jenkins-hbase4:34259] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34259,1689916199459' 2023-07-21 05:10:01,569 DEBUG [RS:1;jenkins-hbase4:34259] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-21 05:10:01,569 DEBUG [RS:0;jenkins-hbase4:42011] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 05:10:01,569 DEBUG [RS:2;jenkins-hbase4:41899] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 05:10:01,569 DEBUG [RS:1;jenkins-hbase4:34259] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-21 05:10:01,571 DEBUG [RS:0;jenkins-hbase4:42011] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 05:10:01,571 DEBUG [RS:0;jenkins-hbase4:42011] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 05:10:01,571 DEBUG [RS:0;jenkins-hbase4:42011] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:01,571 DEBUG [RS:0;jenkins-hbase4:42011] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42011,1689916199401' 2023-07-21 05:10:01,571 DEBUG [RS:2;jenkins-hbase4:41899] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 05:10:01,571 DEBUG [RS:2;jenkins-hbase4:41899] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 05:10:01,571 DEBUG [RS:0;jenkins-hbase4:42011] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:01,572 DEBUG [RS:1;jenkins-hbase4:34259] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-21 05:10:01,572 DEBUG [RS:0;jenkins-hbase4:42011] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:01,572 DEBUG [RS:1;jenkins-hbase4:34259] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-21 05:10:01,573 DEBUG [RS:1;jenkins-hbase4:34259] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:01,573 DEBUG [RS:1;jenkins-hbase4:34259] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34259,1689916199459' 2023-07-21 05:10:01,573 DEBUG [RS:1;jenkins-hbase4:34259] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:01,574 DEBUG [RS:1;jenkins-hbase4:34259] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:01,575 DEBUG [RS:1;jenkins-hbase4:34259] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 05:10:01,575 INFO [RS:1;jenkins-hbase4:34259] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 05:10:01,575 INFO [RS:1;jenkins-hbase4:34259] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 05:10:01,571 DEBUG [RS:2;jenkins-hbase4:41899] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:01,573 DEBUG [RS:0;jenkins-hbase4:42011] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 05:10:01,575 DEBUG [RS:2;jenkins-hbase4:41899] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41899,1689916199499' 2023-07-21 05:10:01,575 INFO [RS:0;jenkins-hbase4:42011] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 05:10:01,576 DEBUG [RS:2;jenkins-hbase4:41899] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:01,576 INFO [RS:0;jenkins-hbase4:42011] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 05:10:01,579 DEBUG [RS:2;jenkins-hbase4:41899] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:01,580 DEBUG [RS:2;jenkins-hbase4:41899] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-21 05:10:01,580 INFO [RS:2;jenkins-hbase4:41899] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-21 05:10:01,580 INFO [RS:2;jenkins-hbase4:41899] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-21 05:10:01,646 DEBUG [jenkins-hbase4:44111] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-21 05:10:01,650 DEBUG [jenkins-hbase4:44111] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:01,657 DEBUG [jenkins-hbase4:44111] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:01,657 DEBUG [jenkins-hbase4:44111] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:01,657 DEBUG [jenkins-hbase4:44111] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:01,657 DEBUG [jenkins-hbase4:44111] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:01,661 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41899,1689916199499, state=OPENING 2023-07-21 05:10:01,671 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-21 05:10:01,673 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:01,673 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 05:10:01,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:10:01,691 INFO [RS:0;jenkins-hbase4:42011] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42011%2C1689916199401, suffix=, logDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,42011,1689916199401, archiveDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/oldWALs, maxLogs=32 2023-07-21 05:10:01,692 INFO [RS:2;jenkins-hbase4:41899] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41899%2C1689916199499, suffix=, logDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,41899,1689916199499, archiveDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/oldWALs, maxLogs=32 2023-07-21 05:10:01,694 INFO [RS:1;jenkins-hbase4:34259] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34259%2C1689916199459, suffix=, logDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,34259,1689916199459, archiveDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/oldWALs, maxLogs=32 2023-07-21 05:10:01,740 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK] 2023-07-21 05:10:01,747 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK] 2023-07-21 05:10:01,747 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK] 2023-07-21 05:10:01,748 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK] 2023-07-21 05:10:01,768 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK] 2023-07-21 05:10:01,769 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK] 2023-07-21 05:10:01,769 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK] 2023-07-21 05:10:01,770 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK] 2023-07-21 05:10:01,771 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK] 2023-07-21 05:10:01,784 INFO [RS:1;jenkins-hbase4:34259] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,34259,1689916199459/jenkins-hbase4.apache.org%2C34259%2C1689916199459.1689916201701 2023-07-21 05:10:01,788 DEBUG [RS:1;jenkins-hbase4:34259] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK], DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK]] 2023-07-21 05:10:01,790 INFO [RS:0;jenkins-hbase4:42011] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,42011,1689916199401/jenkins-hbase4.apache.org%2C42011%2C1689916199401.1689916201701 2023-07-21 05:10:01,790 DEBUG [RS:0;jenkins-hbase4:42011] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK], DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK]] 2023-07-21 05:10:01,793 INFO [RS:2;jenkins-hbase4:41899] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,41899,1689916199499/jenkins-hbase4.apache.org%2C41899%2C1689916199499.1689916201701 2023-07-21 05:10:01,799 DEBUG [RS:2;jenkins-hbase4:41899] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK], DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK], DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK]] 2023-07-21 05:10:01,882 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:01,885 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:10:01,889 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:10:01,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-21 05:10:01,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-21 05:10:01,913 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41899%2C1689916199499.meta, suffix=.meta, logDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,41899,1689916199499, archiveDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/oldWALs, maxLogs=32 2023-07-21 05:10:01,940 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK] 2023-07-21 05:10:01,943 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK] 2023-07-21 05:10:01,944 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK] 2023-07-21 05:10:01,957 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/WALs/jenkins-hbase4.apache.org,41899,1689916199499/jenkins-hbase4.apache.org%2C41899%2C1689916199499.meta.1689916201914.meta 2023-07-21 05:10:01,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36953,DS-299974bb-c42b-4bd2-a161-37dfeb509a44,DISK], DatanodeInfoWithStorage[127.0.0.1:43037,DS-7562f45c-a16e-4ff8-902d-9ad0ef2c6360,DISK], DatanodeInfoWithStorage[127.0.0.1:45705,DS-481bd382-5b2a-4709-bc1e-d43d0057c6ad,DISK]] 2023-07-21 05:10:01,958 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:10:01,960 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-21 05:10:01,961 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:01,963 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-21 05:10:01,965 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-21 05:10:01,967 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-21 05:10:01,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-21 05:10:01,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:01,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-21 05:10:01,986 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-21 05:10:01,990 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-21 05:10:01,993 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/info 2023-07-21 05:10:01,993 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/info 2023-07-21 05:10:01,993 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-21 05:10:01,994 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,994 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-21 05:10:01,996 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/rep_barrier 2023-07-21 05:10:01,996 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/rep_barrier 2023-07-21 05:10:01,997 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-21 05:10:01,999 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:01,999 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-21 05:10:02,001 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/table 2023-07-21 05:10:02,001 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/table 2023-07-21 05:10:02,002 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-21 05:10:02,003 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:02,006 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740 2023-07-21 05:10:02,009 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740 2023-07-21 05:10:02,014 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-21 05:10:02,017 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-21 05:10:02,019 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73449856, jitterRate=0.09448814392089844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-21 05:10:02,022 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-21 05:10:02,038 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689916201871 2023-07-21 05:10:02,071 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41899,1689916199499, state=OPEN 2023-07-21 05:10:02,080 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-21 05:10:02,081 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-21 05:10:02,082 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-21 05:10:02,082 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-21 05:10:02,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-21 05:10:02,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41899,1689916199499 in 405 msec 2023-07-21 05:10:02,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-21 05:10:02,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 633 msec 2023-07-21 05:10:02,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0780 sec 2023-07-21 05:10:02,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689916202113, completionTime=-1 2023-07-21 05:10:02,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-21 05:10:02,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-21 05:10:02,213 DEBUG [hconnection-0x3a9d7326-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:02,216 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:02,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-21 05:10:02,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689916262247 2023-07-21 05:10:02,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689916322247 2023-07-21 05:10:02,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 133 msec 2023-07-21 05:10:02,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44111,1689916197930-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44111,1689916197930-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44111,1689916197930-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44111, period=300000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-21 05:10:02,287 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-21 05:10:02,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-21 05:10:02,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 05:10:02,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-21 05:10:02,314 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:02,319 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:02,348 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:10:02,351 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef empty. 2023-07-21 05:10:02,351 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:10:02,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-21 05:10:02,391 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:02,393 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9cd2fbb292b580362c0bf2caed0c17ef, NAME => 'hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:10:02,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:02,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 9cd2fbb292b580362c0bf2caed0c17ef, disabling compactions & flushes 2023-07-21 05:10:02,409 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:10:02,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:10:02,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. after waiting 0 ms 2023-07-21 05:10:02,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:10:02,409 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:10:02,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 9cd2fbb292b580362c0bf2caed0c17ef: 2023-07-21 05:10:02,414 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:02,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689916202416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916202416"}]},"ts":"1689916202416"} 2023-07-21 05:10:02,456 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 05:10:02,458 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:02,462 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916202458"}]},"ts":"1689916202458"} 2023-07-21 05:10:02,468 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-21 05:10:02,490 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:02,491 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:02,491 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:02,491 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:02,491 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:02,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9cd2fbb292b580362c0bf2caed0c17ef, ASSIGN}] 2023-07-21 05:10:02,498 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9cd2fbb292b580362c0bf2caed0c17ef, ASSIGN 2023-07-21 05:10:02,500 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9cd2fbb292b580362c0bf2caed0c17ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34259,1689916199459; forceNewPlan=false, retain=false 2023-07-21 05:10:02,656 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 05:10:02,659 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9cd2fbb292b580362c0bf2caed0c17ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:02,659 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689916202659"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916202659"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916202659"}]},"ts":"1689916202659"} 2023-07-21 05:10:02,664 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9cd2fbb292b580362c0bf2caed0c17ef, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:10:02,820 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:02,821 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:10:02,833 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:10:02,846 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:10:02,846 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9cd2fbb292b580362c0bf2caed0c17ef, NAME => 'hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef.', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:10:02,847 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. service=AccessControlService 2023-07-21 05:10:02,848 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:02,848 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:10:02,848 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:02,848 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:10:02,848 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:10:02,851 INFO [StoreOpener-9cd2fbb292b580362c0bf2caed0c17ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:10:02,854 DEBUG [StoreOpener-9cd2fbb292b580362c0bf2caed0c17ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef/info 2023-07-21 05:10:02,854 DEBUG [StoreOpener-9cd2fbb292b580362c0bf2caed0c17ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef/info 2023-07-21 05:10:02,855 INFO [StoreOpener-9cd2fbb292b580362c0bf2caed0c17ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9cd2fbb292b580362c0bf2caed0c17ef columnFamilyName info 2023-07-21 05:10:02,856 INFO [StoreOpener-9cd2fbb292b580362c0bf2caed0c17ef-1] regionserver.HStore(310): Store=9cd2fbb292b580362c0bf2caed0c17ef/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:02,858 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:10:02,860 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:10:02,865 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:10:02,869 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:02,870 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9cd2fbb292b580362c0bf2caed0c17ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61143456, jitterRate=-0.08889150619506836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:02,870 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9cd2fbb292b580362c0bf2caed0c17ef: 2023-07-21 05:10:02,872 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef., pid=6, masterSystemTime=1689916202820 2023-07-21 05:10:02,878 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:10:02,878 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:10:02,879 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9cd2fbb292b580362c0bf2caed0c17ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:02,880 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689916202879"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916202879"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916202879"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916202879"}]},"ts":"1689916202879"} 2023-07-21 05:10:02,890 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-21 05:10:02,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9cd2fbb292b580362c0bf2caed0c17ef, server=jenkins-hbase4.apache.org,34259,1689916199459 in 220 msec 2023-07-21 05:10:02,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-21 05:10:02,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9cd2fbb292b580362c0bf2caed0c17ef, ASSIGN in 397 msec 2023-07-21 05:10:02,900 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:02,900 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916202900"}]},"ts":"1689916202900"} 2023-07-21 05:10:02,904 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-21 05:10:02,909 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:02,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-21 05:10:02,915 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-21 05:10:02,915 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:02,923 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 611 msec 2023-07-21 05:10:02,945 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:02,950 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:02,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-21 05:10:02,985 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 05:10:02,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-07-21 05:10:03,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-21 05:10:03,026 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-21 05:10:03,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 31 msec 2023-07-21 05:10:03,043 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-21 05:10:03,047 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-21 05:10:03,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.470sec 2023-07-21 05:10:03,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-21 05:10:03,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-21 05:10:03,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-21 05:10:03,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44111,1689916197930-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-21 05:10:03,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44111,1689916197930-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-21 05:10:03,079 DEBUG [Listener at localhost/40309] zookeeper.ReadOnlyZKClient(139): Connect 0x019b73aa to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:03,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-21 05:10:03,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-21 05:10:03,095 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:03,097 DEBUG [Listener at localhost/40309] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65c198d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:03,097 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:03,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-21 05:10:03,105 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:10:03,112 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d empty. 2023-07-21 05:10:03,115 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:10:03,115 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-21 05:10:03,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 05:10:03,124 DEBUG [hconnection-0x69b728c0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:03,141 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:03,146 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:10:03,146 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-21 05:10:03,146 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/test.cache.data in system properties and HBase conf 2023-07-21 05:10:03,149 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop.tmp.dir in system properties and HBase conf 2023-07-21 05:10:03,149 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop.log.dir in system properties and HBase conf 2023-07-21 05:10:03,149 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-21 05:10:03,149 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-21 05:10:03,149 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-21 05:10:03,152 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-21 05:10:03,152 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-21 05:10:03,153 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-21 05:10:03,153 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 05:10:03,153 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-21 05:10:03,153 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-21 05:10:03,153 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-21 05:10:03,153 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 05:10:03,153 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-21 05:10:03,153 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/nfs.dump.dir in system properties and HBase conf 2023-07-21 05:10:03,154 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir in system properties and HBase conf 2023-07-21 05:10:03,154 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-21 05:10:03,154 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-21 05:10:03,154 INFO [Listener at localhost/40309] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-21 05:10:03,167 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:03,177 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ea4e10d61fe9dcc96a189a79e7ebb45d, NAME => 'hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:10:03,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 05:10:03,238 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:03,239 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ea4e10d61fe9dcc96a189a79e7ebb45d, disabling compactions & flushes 2023-07-21 05:10:03,240 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:10:03,240 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:10:03,240 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. after waiting 0 ms 2023-07-21 05:10:03,240 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:10:03,240 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:10:03,240 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ea4e10d61fe9dcc96a189a79e7ebb45d: 2023-07-21 05:10:03,259 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:03,263 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689916203263"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916203263"}]},"ts":"1689916203263"} 2023-07-21 05:10:03,267 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-21 05:10:03,269 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:03,269 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916203269"}]},"ts":"1689916203269"} 2023-07-21 05:10:03,272 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-21 05:10:03,284 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:03,288 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:03,288 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:03,288 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:03,289 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:03,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ea4e10d61fe9dcc96a189a79e7ebb45d, ASSIGN}] 2023-07-21 05:10:03,297 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ea4e10d61fe9dcc96a189a79e7ebb45d, ASSIGN 2023-07-21 05:10:03,299 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ea4e10d61fe9dcc96a189a79e7ebb45d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34259,1689916199459; forceNewPlan=false, retain=false 2023-07-21 05:10:03,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 05:10:03,450 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 05:10:03,451 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ea4e10d61fe9dcc96a189a79e7ebb45d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:03,452 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689916203451"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916203451"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916203451"}]},"ts":"1689916203451"} 2023-07-21 05:10:03,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ea4e10d61fe9dcc96a189a79e7ebb45d, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:10:03,623 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:10:03,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea4e10d61fe9dcc96a189a79e7ebb45d, NAME => 'hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d.', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:10:03,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. service=AccessControlService 2023-07-21 05:10:03,624 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:03,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:10:03,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:03,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:10:03,625 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:10:03,631 INFO [StoreOpener-ea4e10d61fe9dcc96a189a79e7ebb45d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:10:03,635 DEBUG [StoreOpener-ea4e10d61fe9dcc96a189a79e7ebb45d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d/l 2023-07-21 05:10:03,635 DEBUG [StoreOpener-ea4e10d61fe9dcc96a189a79e7ebb45d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d/l 2023-07-21 05:10:03,636 INFO [StoreOpener-ea4e10d61fe9dcc96a189a79e7ebb45d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea4e10d61fe9dcc96a189a79e7ebb45d columnFamilyName l 2023-07-21 05:10:03,637 INFO [StoreOpener-ea4e10d61fe9dcc96a189a79e7ebb45d-1] regionserver.HStore(310): Store=ea4e10d61fe9dcc96a189a79e7ebb45d/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:03,639 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:10:03,640 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:10:03,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:10:03,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:03,652 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea4e10d61fe9dcc96a189a79e7ebb45d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59354899, jitterRate=-0.11554308235645294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:03,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea4e10d61fe9dcc96a189a79e7ebb45d: 2023-07-21 05:10:03,654 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d., pid=11, masterSystemTime=1689916203614 2023-07-21 05:10:03,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:10:03,658 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:10:03,659 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ea4e10d61fe9dcc96a189a79e7ebb45d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:03,659 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689916203659"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916203659"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916203659"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916203659"}]},"ts":"1689916203659"} 2023-07-21 05:10:03,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-21 05:10:03,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ea4e10d61fe9dcc96a189a79e7ebb45d, server=jenkins-hbase4.apache.org,34259,1689916199459 in 209 msec 2023-07-21 05:10:03,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-21 05:10:03,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ea4e10d61fe9dcc96a189a79e7ebb45d, ASSIGN in 385 msec 2023-07-21 05:10:03,681 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:03,682 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916203681"}]},"ts":"1689916203681"} 2023-07-21 05:10:03,684 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-21 05:10:03,689 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:03,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 600 msec 2023-07-21 05:10:03,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-21 05:10:03,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-21 05:10:03,748 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-21 05:10:04,595 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:10:04,970 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:10:04,977 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35323_jobhistory____.w2x8hx/webapp 2023-07-21 05:10:05,222 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-21 05:10:05,222 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-21 05:10:05,222 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 05:10:05,225 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 05:10:05,312 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:05,652 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:06,097 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-21 05:10:06,168 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35323 2023-07-21 05:10:07,539 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:10:07,610 WARN [Listener at jenkins-hbase4.apache.org/43401] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:10:07,931 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-21 05:10:07,933 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-21 05:10:07,934 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-21 05:10:07,982 WARN [Listener at jenkins-hbase4.apache.org/43401] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 05:10:07,983 INFO [Listener at jenkins-hbase4.apache.org/43401] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:10:08,010 INFO [Listener at jenkins-hbase4.apache.org/43401] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42299_cluster____.oh02gg/webapp 2023-07-21 05:10:08,098 INFO [Listener at jenkins-hbase4.apache.org/43401] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 05:10:08,098 INFO [Listener at jenkins-hbase4.apache.org/43401] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-21 05:10:08,098 INFO [Listener at jenkins-hbase4.apache.org/43401] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 05:10:08,099 INFO [Listener at jenkins-hbase4.apache.org/43401] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 05:10:08,102 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:08,102 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-21 05:10:08,103 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:08,103 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-21 05:10:08,103 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 05:10:08,103 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-21 05:10:08,103 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:08,103 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-21 05:10:08,103 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 05:10:08,103 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-21 05:10:08,110 INFO [Listener at jenkins-hbase4.apache.org/43401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:08,338 INFO [Listener at jenkins-hbase4.apache.org/43401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:08,456 INFO [Listener at jenkins-hbase4.apache.org/43401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:08,463 INFO [Listener at jenkins-hbase4.apache.org/43401] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42299 2023-07-21 05:10:08,970 WARN [Listener at jenkins-hbase4.apache.org/36751] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:10:09,000 WARN [Listener at jenkins-hbase4.apache.org/36751] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 05:10:09,001 INFO [Listener at jenkins-hbase4.apache.org/36751] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:10:09,013 INFO [Listener at jenkins-hbase4.apache.org/36751] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45539_node____.eozuko/webapp 2023-07-21 05:10:09,093 INFO [Listener at jenkins-hbase4.apache.org/36751] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 05:10:09,094 INFO [Listener at jenkins-hbase4.apache.org/36751] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 05:10:09,094 INFO [Listener at jenkins-hbase4.apache.org/36751] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 05:10:09,094 INFO [Listener at jenkins-hbase4.apache.org/36751] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 05:10:09,105 INFO [Listener at jenkins-hbase4.apache.org/36751] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,138 INFO [Listener at jenkins-hbase4.apache.org/36751] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,240 INFO [Listener at jenkins-hbase4.apache.org/36751] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,268 INFO [Listener at jenkins-hbase4.apache.org/36751] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45539 2023-07-21 05:10:09,551 WARN [Listener at jenkins-hbase4.apache.org/42887] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-21 05:10:09,558 WARN [Listener at jenkins-hbase4.apache.org/42887] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-21 05:10:09,558 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): jetty-6.1.26 2023-07-21 05:10:09,566 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43045_node____wup8uo/webapp 2023-07-21 05:10:09,628 INFO [Listener at jenkins-hbase4.apache.org/42887] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-21 05:10:09,628 INFO [Listener at jenkins-hbase4.apache.org/42887] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-21 05:10:09,629 INFO [Listener at jenkins-hbase4.apache.org/42887] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-21 05:10:09,629 INFO [Listener at jenkins-hbase4.apache.org/42887] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-21 05:10:09,641 INFO [Listener at jenkins-hbase4.apache.org/42887] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,658 INFO [Listener at jenkins-hbase4.apache.org/42887] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,734 INFO [Listener at jenkins-hbase4.apache.org/42887] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-21 05:10:09,746 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43045 2023-07-21 05:10:09,771 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-21 05:10:09,773 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:09,842 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=382, ProcessCount=177, AvailableMemoryMB=4411 2023-07-21 05:10:09,842 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-07-21 05:10:09,857 DEBUG [Listener at jenkins-hbase4.apache.org/42887] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-21 05:10:09,863 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-21 05:10:09,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 05:10:09,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:09,876 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:09,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-21 05:10:09,879 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:09,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:09,883 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:09,883 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:09,885 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6 empty. 2023-07-21 05:10:09,885 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3 empty. 2023-07-21 05:10:09,886 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:09,886 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:09,886 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 05:10:09,920 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:09,922 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => c90321cd313c13bc9935bf7f6a55e1f6, NAME => 'testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:10:09,922 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 750cb8b7acf23c183d266f00f4f0b9d3, NAME => 'testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:10:09,963 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:09,963 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 750cb8b7acf23c183d266f00f4f0b9d3, disabling compactions & flushes 2023-07-21 05:10:09,964 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:09,964 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:09,964 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. after waiting 0 ms 2023-07-21 05:10:09,964 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:09,964 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:09,964 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 750cb8b7acf23c183d266f00f4f0b9d3: 2023-07-21 05:10:09,964 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:09,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing c90321cd313c13bc9935bf7f6a55e1f6, disabling compactions & flushes 2023-07-21 05:10:09,965 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:09,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:09,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. after waiting 0 ms 2023-07-21 05:10:09,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:09,965 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:09,965 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for c90321cd313c13bc9935bf7f6a55e1f6: 2023-07-21 05:10:09,968 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:09,970 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916209970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916209970"}]},"ts":"1689916209970"} 2023-07-21 05:10:09,970 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916209970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916209970"}]},"ts":"1689916209970"} 2023-07-21 05:10:09,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:10,017 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:10:10,019 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:10,019 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916210019"}]},"ts":"1689916210019"} 2023-07-21 05:10:10,021 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-21 05:10:10,025 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:10,027 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:10,027 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:10,027 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:10,027 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:10,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c90321cd313c13bc9935bf7f6a55e1f6, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=750cb8b7acf23c183d266f00f4f0b9d3, ASSIGN}] 2023-07-21 05:10:10,031 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=750cb8b7acf23c183d266f00f4f0b9d3, ASSIGN 2023-07-21 05:10:10,031 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c90321cd313c13bc9935bf7f6a55e1f6, ASSIGN 2023-07-21 05:10:10,032 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=750cb8b7acf23c183d266f00f4f0b9d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42011,1689916199401; forceNewPlan=false, retain=false 2023-07-21 05:10:10,032 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c90321cd313c13bc9935bf7f6a55e1f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34259,1689916199459; forceNewPlan=false, retain=false 2023-07-21 05:10:10,182 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:10:10,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:10,185 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c90321cd313c13bc9935bf7f6a55e1f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:10,185 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=750cb8b7acf23c183d266f00f4f0b9d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:10,185 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916210185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916210185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916210185"}]},"ts":"1689916210185"} 2023-07-21 05:10:10,185 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916210185"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916210185"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916210185"}]},"ts":"1689916210185"} 2023-07-21 05:10:10,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure c90321cd313c13bc9935bf7f6a55e1f6, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:10:10,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 750cb8b7acf23c183d266f00f4f0b9d3, server=jenkins-hbase4.apache.org,42011,1689916199401}] 2023-07-21 05:10:10,344 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:10,344 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:10:10,350 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:10:10,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:10,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c90321cd313c13bc9935bf7f6a55e1f6, NAME => 'testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:10:10,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. service=AccessControlService 2023-07-21 05:10:10,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:10,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:10,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:10,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:10,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:10,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:10,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 750cb8b7acf23c183d266f00f4f0b9d3, NAME => 'testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:10:10,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. service=AccessControlService 2023-07-21 05:10:10,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:10,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:10,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:10,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:10,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:10,363 INFO [StoreOpener-c90321cd313c13bc9935bf7f6a55e1f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:10,364 INFO [StoreOpener-750cb8b7acf23c183d266f00f4f0b9d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:10,365 DEBUG [StoreOpener-c90321cd313c13bc9935bf7f6a55e1f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/cf 2023-07-21 05:10:10,365 DEBUG [StoreOpener-c90321cd313c13bc9935bf7f6a55e1f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/cf 2023-07-21 05:10:10,368 DEBUG [StoreOpener-750cb8b7acf23c183d266f00f4f0b9d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/cf 2023-07-21 05:10:10,368 DEBUG [StoreOpener-750cb8b7acf23c183d266f00f4f0b9d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/cf 2023-07-21 05:10:10,369 INFO [StoreOpener-c90321cd313c13bc9935bf7f6a55e1f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c90321cd313c13bc9935bf7f6a55e1f6 columnFamilyName cf 2023-07-21 05:10:10,369 INFO [StoreOpener-750cb8b7acf23c183d266f00f4f0b9d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 750cb8b7acf23c183d266f00f4f0b9d3 columnFamilyName cf 2023-07-21 05:10:10,372 INFO [StoreOpener-750cb8b7acf23c183d266f00f4f0b9d3-1] regionserver.HStore(310): Store=750cb8b7acf23c183d266f00f4f0b9d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:10,372 INFO [StoreOpener-c90321cd313c13bc9935bf7f6a55e1f6-1] regionserver.HStore(310): Store=c90321cd313c13bc9935bf7f6a55e1f6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:10,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:10,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:10,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:10,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:10,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:10,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:10,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:10,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:10,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 750cb8b7acf23c183d266f00f4f0b9d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68700729, jitterRate=0.0237206369638443}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:10,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 750cb8b7acf23c183d266f00f4f0b9d3: 2023-07-21 05:10:10,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c90321cd313c13bc9935bf7f6a55e1f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73698511, jitterRate=0.09819339215755463}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:10,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c90321cd313c13bc9935bf7f6a55e1f6: 2023-07-21 05:10:10,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3., pid=16, masterSystemTime=1689916210344 2023-07-21 05:10:10,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6., pid=15, masterSystemTime=1689916210341 2023-07-21 05:10:10,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:10,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:10,410 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=750cb8b7acf23c183d266f00f4f0b9d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:10,410 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916210410"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916210410"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916210410"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916210410"}]},"ts":"1689916210410"} 2023-07-21 05:10:10,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:10,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:10,414 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c90321cd313c13bc9935bf7f6a55e1f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:10,415 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916210414"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916210414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916210414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916210414"}]},"ts":"1689916210414"} 2023-07-21 05:10:10,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-21 05:10:10,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 750cb8b7acf23c183d266f00f4f0b9d3, server=jenkins-hbase4.apache.org,42011,1689916199401 in 226 msec 2023-07-21 05:10:10,422 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-21 05:10:10,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure c90321cd313c13bc9935bf7f6a55e1f6, server=jenkins-hbase4.apache.org,34259,1689916199459 in 230 msec 2023-07-21 05:10:10,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=750cb8b7acf23c183d266f00f4f0b9d3, ASSIGN in 392 msec 2023-07-21 05:10:10,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-21 05:10:10,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c90321cd313c13bc9935bf7f6a55e1f6, ASSIGN in 398 msec 2023-07-21 05:10:10,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:10,431 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916210431"}]},"ts":"1689916210431"} 2023-07-21 05:10:10,433 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-21 05:10:10,436 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:10,441 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-21 05:10:10,449 DEBUG [hconnection-0x5eb1ab3a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:10,452 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-21 05:10:10,461 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 05:10:10,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:10,489 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:10,489 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:10,489 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:10,489 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:10,489 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:10:10,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:10,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:10,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:10,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:10,504 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 627 msec 2023-07-21 05:10:10,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-21 05:10:10,988 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-21 05:10:10,993 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-21 05:10:10,995 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:10,998 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:11,027 DEBUG [hconnection-0x69b728c0-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,042 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,047 DEBUG [hconnection-0x69b728c0-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,056 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:11,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916211073 (current time:1689916211073). 2023-07-21 05:10:11,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:11,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x73627810 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:11,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a93fc2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:11,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,089 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73627810 to 127.0.0.1:51418 2023-07-21 05:10:11,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:11,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x02a8cf84 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:11,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f091890, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:11,201 DEBUG [hconnection-0x62a662d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,205 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,211 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02a8cf84 to 127.0.0.1:51418 2023-07-21 05:10:11,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:11,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 05:10:11,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:11,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:11,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,278 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,279 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689916811279 2023-07-21 05:10:11,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:11,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 05:10:11,283 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,284 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-21 05:10:11,287 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,288 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:11,288 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:11,289 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689916811289 2023-07-21 05:10:11,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,311 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-21 05:10:11,311 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,312 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 05:10:11,312 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 05:10:11,313 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,313 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,318 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,318 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,318 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,318 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,319 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,319 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,320 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,320 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:11,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,320 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 05:10:11,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 05:10:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-21 05:10:11,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,322 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:11,322 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:11,322 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:11,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,334 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,334 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:11,334 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,342 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:11,342 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:11,342 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:11,342 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:11,342 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,342 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:11,343 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:11,343 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:11,343 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:11,343 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:11,344 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:11,347 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,347 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,349 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,349 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,349 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,349 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:11,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,350 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,351 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 05:10:11,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2913401f[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-21 05:10:11,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2913401f[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:11,357 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 05:10:11,357 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,359 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,360 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,360 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,360 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:10:11,361 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,361 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:11,364 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:11,364 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,364 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:11,371 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:11,371 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:11,371 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:11,371 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:11,372 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:11,372 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:11,372 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. started... 2023-07-21 05:10:11,372 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. started... 2023-07-21 05:10:11,376 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 750cb8b7acf23c183d266f00f4f0b9d3: 2023-07-21 05:10:11,376 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c90321cd313c13bc9935bf7f6a55e1f6: 2023-07-21 05:10:11,377 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,377 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,382 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:11,382 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:11,386 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:11,386 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:11,388 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:11,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:11,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:11,396 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:11,427 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. completed. 2023-07-21 05:10:11,428 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:11,428 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:11,428 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. completed. 2023-07-21 05:10:11,428 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:11,428 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:11,428 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:11,428 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:11,428 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,428 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,428 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:10:11,429 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:10:11,431 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,431 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:11,431 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:11,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,432 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,432 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:11,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42011,1689916199401': 2023-07-21 05:10:11,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 05:10:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:10:11,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 05:10:11,443 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-21 05:10:11,443 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:11,443 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:11,443 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,444 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:11,447 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,447 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:11,447 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,447 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,448 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,449 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,450 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:11,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,452 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:11,452 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,452 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,469 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,469 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,469 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,469 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,469 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:11,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,469 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,470 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:11,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-21 05:10:11,470 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:11,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,470 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:10:11,471 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:11,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:11,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,470 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,472 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,472 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,472 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:11,472 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,472 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:11,472 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:11,472 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,472 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 05:10:11,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:11,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:11,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,596 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:11,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:11,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:11,598 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:10:11,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 05:10:11,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,625 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:11,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689916211280Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689916211495 (+215 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689916211495Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689916211495Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689916211509 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689916211550 (+41 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689916211624 (+74 ms) 2023-07-21 05:10:11,629 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 348 msec 2023-07-21 05:10:11,899 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:11,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:11,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:11,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34259] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:11,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42011] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:11,925 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-21 05:10:11,925 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:11,925 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:11,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:11,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916211940 (current time:1689916211940). 2023-07-21 05:10:11,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:11,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x4ad64868 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:11,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6050976a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:11,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,959 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ad64868 to 127.0.0.1:51418 2023-07-21 05:10:11,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:11,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x1fc74747 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:11,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@672ac9df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:11,968 DEBUG [hconnection-0x3a5f997-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,971 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:11,977 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:11,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fc74747 to 127.0.0.1:51418 2023-07-21 05:10:11,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:11,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-21 05:10:11,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:11,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:11,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,984 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,985 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689916811985 2023-07-21 05:10:11,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-21 05:10:11,985 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-21 05:10:11,986 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:11,986 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:11,987 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-21 05:10:11,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,989 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-21 05:10:11,990 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:11,991 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689916811991 2023-07-21 05:10:12,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-21 05:10:12,008 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-21 05:10:12,008 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:12,009 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-21 05:10:12,009 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-21 05:10:12,009 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,009 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,011 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:12,011 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,011 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:12,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:12,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:12,011 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:12,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:12,012 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,012 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,013 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,013 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:12,014 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:12,014 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-21 05:10:12,014 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 05:10:12,014 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 05:10:12,014 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-21 05:10:12,014 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:12,014 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:12,014 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-21 05:10:12,014 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:12,014 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:12,015 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:12,014 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:12,016 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:12,016 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:12,016 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-21 05:10:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-21 05:10:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:12,017 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-21 05:10:12,019 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,019 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:12,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:12,020 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,020 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:12,020 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,020 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:12,021 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,021 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:12,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:12,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,022 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,022 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,022 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:12,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 05:10:12,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@347d0883[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:12,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:12,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:12,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:12,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:12,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-21 05:10:12,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@347d0883[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:12,026 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-21 05:10:12,026 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,031 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:10:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-21 05:10:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:12,032 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:12,032 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,032 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. started... 2023-07-21 05:10:12,032 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:12,032 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:12,032 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. started... 2023-07-21 05:10:12,032 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 750cb8b7acf23c183d266f00f4f0b9d3 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-21 05:10:12,032 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:12,033 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c90321cd313c13bc9935bf7f6a55e1f6 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-21 05:10:12,035 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:12,035 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:12,035 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:12,086 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:12,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:12,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:12,088 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:12,181 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307211bd9126227314db8b68329076564c1ba to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307211bd9126227314db8b68329076564c1ba 2023-07-21 05:10:12,181 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230721bee92ee8e38e4ac0a7c264041db78ebe to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721bee92ee8e38e4ac0a7c264041db78ebe 2023-07-21 05:10:12,212 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/.tmp/cf/d938c85f44bc401fbb54e106a1515edf 2023-07-21 05:10:12,220 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/.tmp/cf/8ed5a7d4b7d0440f90dd6d5be42a5825 2023-07-21 05:10:12,223 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/.tmp/cf/d938c85f44bc401fbb54e106a1515edf as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/cf/d938c85f44bc401fbb54e106a1515edf 2023-07-21 05:10:12,230 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/.tmp/cf/8ed5a7d4b7d0440f90dd6d5be42a5825 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/cf/8ed5a7d4b7d0440f90dd6d5be42a5825 2023-07-21 05:10:12,231 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/cf/d938c85f44bc401fbb54e106a1515edf, entries=2, sequenceid=6, filesize=5.2 K 2023-07-21 05:10:12,234 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c90321cd313c13bc9935bf7f6a55e1f6 in 201ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:12,234 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-21 05:10:12,235 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c90321cd313c13bc9935bf7f6a55e1f6: 2023-07-21 05:10:12,236 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 05:10:12,236 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:12,236 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/cf/d938c85f44bc401fbb54e106a1515edf] hfiles 2023-07-21 05:10:12,236 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/cf/d938c85f44bc401fbb54e106a1515edf for snapshot=snaptb0-testExportWithTargetName 2023-07-21 05:10:12,238 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/cf/8ed5a7d4b7d0440f90dd6d5be42a5825, entries=48, sequenceid=6, filesize=13.0 K 2023-07-21 05:10:12,241 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 750cb8b7acf23c183d266f00f4f0b9d3 in 209ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:12,242 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 750cb8b7acf23c183d266f00f4f0b9d3: 2023-07-21 05:10:12,242 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 05:10:12,242 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:12,242 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/cf/8ed5a7d4b7d0440f90dd6d5be42a5825] hfiles 2023-07-21 05:10:12,242 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/cf/8ed5a7d4b7d0440f90dd6d5be42a5825 for snapshot=snaptb0-testExportWithTargetName 2023-07-21 05:10:12,264 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. completed. 2023-07-21 05:10:12,264 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,265 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. completed. 2023-07-21 05:10:12,265 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-21 05:10:12,265 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:10:12,267 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,267 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:12,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:12,267 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:12,267 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:12,268 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-21 05:10:12,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:12,268 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:12,268 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,268 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-21 05:10:12,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:12,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:12,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42011,1689916199401': 2023-07-21 05:10:12,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-21 05:10:12,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:12,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:12,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:12,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:10:12,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-21 05:10:12,283 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-21 05:10:12,283 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:12,284 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:12,284 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-21 05:10:12,284 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:12,288 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,288 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,288 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,288 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,288 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,288 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,289 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,289 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,288 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:12,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:12,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:12,291 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:10:12,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,295 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,295 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,301 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,301 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:12,302 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-21 05:10:12,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,314 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,314 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,314 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,314 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:12,314 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:12,314 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:12,314 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,314 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:12,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:12,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:12,314 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:12,314 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,315 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:12,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:12,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:12,314 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-21 05:10:12,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:12,316 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-21 05:10:12,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-21 05:10:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:12,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:10:12,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:12,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:12,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:12,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307211bd9126227314db8b68329076564c1ba, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721bee92ee8e38e4ac0a7c264041db78ebe] mob files 2023-07-21 05:10:12,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307211bd9126227314db8b68329076564c1ba 2023-07-21 05:10:12,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721bee92ee8e38e4ac0a7c264041db78ebe 2023-07-21 05:10:12,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-21 05:10:12,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,487 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-21 05:10:12,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,488 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-21 05:10:12,488 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689916211985Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689916212354 (+369 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689916212354Loading Region manifests for snaptb0-testExportWithTargetName at 1689916212355 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689916212368 (+13 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689916212386 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689916212487 (+101 ms) 2023-07-21 05:10:12,492 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-21 05:10:12,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 507 msec 2023-07-21 05:10:12,591 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:12,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-21 05:10:12,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:12,594 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594 2023-07-21 05:10:12,595 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40289, tgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594, rawTgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594, srcFsUri=hdfs://localhost:40289, srcDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:12,635 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:12,635 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_748176040_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 05:10:12,635 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13, snapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-21 05:10:12,655 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-21 05:10:12,726 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:12,727 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:12,727 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:12,728 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:13,790 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-1094770741985591284.jar 2023-07-21 05:10:13,791 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:13,792 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:13,869 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-1670863152816293830.jar 2023-07-21 05:10:13,870 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:13,870 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:13,871 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:13,872 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:13,872 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:13,873 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:13,874 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:10:13,874 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:10:13,875 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:10:13,876 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:10:13,876 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:10:13,877 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:10:13,878 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:10:13,879 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:10:13,879 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:10:13,880 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:10:13,885 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:13,885 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:13,886 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:13,886 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:13,886 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:13,887 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:13,888 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:15,735 WARN [Listener at jenkins-hbase4.apache.org/42887] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:10:15,750 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-21 05:10:15,764 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-21 05:10:15,894 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:10:16,351 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:16,351 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:16,654 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:21,864 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:24,157 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:27,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:28,834 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:10:28,836 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:10:28,846 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-21 05:10:28,847 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:10:28,847 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:10:28,847 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-21 05:10:28,848 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-21 05:10:28,848 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-21 05:10:28,848 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594/.hbase-snapshot/testExportWithTargetName 2023-07-21 05:10:28,849 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-21 05:10:28,849 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916212594/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-21 05:10:28,859 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-21 05:10:28,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-21 05:10:28,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:28,876 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916228876"}]},"ts":"1689916228876"} 2023-07-21 05:10:28,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 05:10:28,878 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-21 05:10:28,880 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-21 05:10:28,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c90321cd313c13bc9935bf7f6a55e1f6, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=750cb8b7acf23c183d266f00f4f0b9d3, UNASSIGN}] 2023-07-21 05:10:28,884 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c90321cd313c13bc9935bf7f6a55e1f6, UNASSIGN 2023-07-21 05:10:28,884 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=750cb8b7acf23c183d266f00f4f0b9d3, UNASSIGN 2023-07-21 05:10:28,885 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c90321cd313c13bc9935bf7f6a55e1f6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:28,885 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=750cb8b7acf23c183d266f00f4f0b9d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:28,885 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916228885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916228885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916228885"}]},"ts":"1689916228885"} 2023-07-21 05:10:28,885 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916228885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916228885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916228885"}]},"ts":"1689916228885"} 2023-07-21 05:10:28,887 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 750cb8b7acf23c183d266f00f4f0b9d3, server=jenkins-hbase4.apache.org,42011,1689916199401}] 2023-07-21 05:10:28,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure c90321cd313c13bc9935bf7f6a55e1f6, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:10:28,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 05:10:29,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:29,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:29,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 750cb8b7acf23c183d266f00f4f0b9d3, disabling compactions & flushes 2023-07-21 05:10:29,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c90321cd313c13bc9935bf7f6a55e1f6, disabling compactions & flushes 2023-07-21 05:10:29,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:29,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:29,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:29,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:29,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. after waiting 0 ms 2023-07-21 05:10:29,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. after waiting 0 ms 2023-07-21 05:10:29,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:29,049 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:29,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:10:29,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:10:29,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:29,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:29,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3. 2023-07-21 05:10:29,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6. 2023-07-21 05:10:29,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 750cb8b7acf23c183d266f00f4f0b9d3: 2023-07-21 05:10:29,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c90321cd313c13bc9935bf7f6a55e1f6: 2023-07-21 05:10:29,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:29,071 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=750cb8b7acf23c183d266f00f4f0b9d3, regionState=CLOSED 2023-07-21 05:10:29,072 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916229071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916229071"}]},"ts":"1689916229071"} 2023-07-21 05:10:29,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:29,073 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=c90321cd313c13bc9935bf7f6a55e1f6, regionState=CLOSED 2023-07-21 05:10:29,073 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689916229073"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916229073"}]},"ts":"1689916229073"} 2023-07-21 05:10:29,076 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-21 05:10:29,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 750cb8b7acf23c183d266f00f4f0b9d3, server=jenkins-hbase4.apache.org,42011,1689916199401 in 186 msec 2023-07-21 05:10:29,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-21 05:10:29,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure c90321cd313c13bc9935bf7f6a55e1f6, server=jenkins-hbase4.apache.org,34259,1689916199459 in 188 msec 2023-07-21 05:10:29,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=750cb8b7acf23c183d266f00f4f0b9d3, UNASSIGN in 196 msec 2023-07-21 05:10:29,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-21 05:10:29,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c90321cd313c13bc9935bf7f6a55e1f6, UNASSIGN in 197 msec 2023-07-21 05:10:29,082 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916229082"}]},"ts":"1689916229082"} 2023-07-21 05:10:29,083 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-21 05:10:29,087 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-21 05:10:29,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-07-21 05:10:29,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-21 05:10:29,180 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-21 05:10:29,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-21 05:10:29,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,196 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-21 05:10:29,198 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,201 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-21 05:10:29,204 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,204 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,204 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,204 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-21 05:10:29,205 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:29,205 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:29,206 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,206 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 05:10:29,206 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 05:10:29,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 05:10:29,206 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,206 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:10:29,206 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:10:29,206 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:10:29,206 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-21 05:10:29,207 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:10:29,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 05:10:29,210 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/recovered.edits] 2023-07-21 05:10:29,210 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/recovered.edits] 2023-07-21 05:10:29,222 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/cf/8ed5a7d4b7d0440f90dd6d5be42a5825 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/cf/8ed5a7d4b7d0440f90dd6d5be42a5825 2023-07-21 05:10:29,222 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/cf/d938c85f44bc401fbb54e106a1515edf to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/cf/d938c85f44bc401fbb54e106a1515edf 2023-07-21 05:10:29,247 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3/recovered.edits/9.seqid 2023-07-21 05:10:29,247 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6/recovered.edits/9.seqid 2023-07-21 05:10:29,248 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/750cb8b7acf23c183d266f00f4f0b9d3 2023-07-21 05:10:29,248 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportWithTargetName/c90321cd313c13bc9935bf7f6a55e1f6 2023-07-21 05:10:29,248 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-21 05:10:29,249 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-21 05:10:29,251 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-21 05:10:29,260 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307211bd9126227314db8b68329076564c1ba to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307211bd9126227314db8b68329076564c1ba 2023-07-21 05:10:29,262 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721bee92ee8e38e4ac0a7c264041db78ebe to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230721bee92ee8e38e4ac0a7c264041db78ebe 2023-07-21 05:10:29,263 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-21 05:10:29,267 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,289 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-21 05:10:29,292 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-21 05:10:29,293 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,293 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-21 05:10:29,294 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916229294"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:29,294 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916229294"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:29,296 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:10:29,296 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c90321cd313c13bc9935bf7f6a55e1f6, NAME => 'testtb-testExportWithTargetName,,1689916209870.c90321cd313c13bc9935bf7f6a55e1f6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 750cb8b7acf23c183d266f00f4f0b9d3, NAME => 'testtb-testExportWithTargetName,1,1689916209870.750cb8b7acf23c183d266f00f4f0b9d3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:10:29,296 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-21 05:10:29,296 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916229296"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:29,298 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-21 05:10:29,301 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-21 05:10:29,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 115 msec 2023-07-21 05:10:29,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-21 05:10:29,313 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-21 05:10:29,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-21 05:10:29,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-21 05:10:29,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-21 05:10:29,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-21 05:10:29,369 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=750 (was 702) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1915921609) connection to jenkins-hbase4.apache.org/172.31.14.131:46261 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1915921609) connection to jenkins-hbase4.apache.org/172.31.14.131:39781 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1915744956_1 at /127.0.0.1:48234 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1320 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:60114 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:34480 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:48244 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=376 (was 382), ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=2750 (was 4411) 2023-07-21 05:10:29,370 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-21 05:10:29,389 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=750, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=376, ProcessCount=183, AvailableMemoryMB=2749 2023-07-21 05:10:29,390 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-21 05:10:29,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 05:10:29,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:29,396 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:29,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-21 05:10:29,398 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:29,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 05:10:29,401 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:29,401 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:29,402 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d empty. 2023-07-21 05:10:29,402 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630 empty. 2023-07-21 05:10:29,403 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:29,403 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:29,403 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 05:10:29,420 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:29,422 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6ab6ca59433f5c4385ad080bef0d1630, NAME => 'testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:10:29,422 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => eb5d7e68b2f15af066d4f71e9ea7734d, NAME => 'testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:10:29,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:29,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing eb5d7e68b2f15af066d4f71e9ea7734d, disabling compactions & flushes 2023-07-21 05:10:29,458 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:29,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:29,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. after waiting 0 ms 2023-07-21 05:10:29,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:29,459 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:29,459 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for eb5d7e68b2f15af066d4f71e9ea7734d: 2023-07-21 05:10:29,459 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:29,460 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6ab6ca59433f5c4385ad080bef0d1630, disabling compactions & flushes 2023-07-21 05:10:29,460 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:29,460 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:29,461 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. after waiting 0 ms 2023-07-21 05:10:29,461 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:29,461 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:29,461 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6ab6ca59433f5c4385ad080bef0d1630: 2023-07-21 05:10:29,464 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:29,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229465"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916229465"}]},"ts":"1689916229465"} 2023-07-21 05:10:29,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229465"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916229465"}]},"ts":"1689916229465"} 2023-07-21 05:10:29,468 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:10:29,469 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:29,469 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916229469"}]},"ts":"1689916229469"} 2023-07-21 05:10:29,471 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 05:10:29,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:29,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:29,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:29,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:29,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:29,476 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb5d7e68b2f15af066d4f71e9ea7734d, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ab6ca59433f5c4385ad080bef0d1630, ASSIGN}] 2023-07-21 05:10:29,479 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ab6ca59433f5c4385ad080bef0d1630, ASSIGN 2023-07-21 05:10:29,479 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb5d7e68b2f15af066d4f71e9ea7734d, ASSIGN 2023-07-21 05:10:29,480 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb5d7e68b2f15af066d4f71e9ea7734d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34259,1689916199459; forceNewPlan=false, retain=false 2023-07-21 05:10:29,480 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ab6ca59433f5c4385ad080bef0d1630, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41899,1689916199499; forceNewPlan=false, retain=false 2023-07-21 05:10:29,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 05:10:29,630 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:10:29,633 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6ab6ca59433f5c4385ad080bef0d1630, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:29,633 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=eb5d7e68b2f15af066d4f71e9ea7734d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:29,633 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916229633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916229633"}]},"ts":"1689916229633"} 2023-07-21 05:10:29,633 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916229633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916229633"}]},"ts":"1689916229633"} 2023-07-21 05:10:29,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 6ab6ca59433f5c4385ad080bef0d1630, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:10:29,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure eb5d7e68b2f15af066d4f71e9ea7734d, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:10:29,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 05:10:29,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:29,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eb5d7e68b2f15af066d4f71e9ea7734d, NAME => 'testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:10:29,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:29,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ab6ca59433f5c4385ad080bef0d1630, NAME => 'testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:10:29,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. service=AccessControlService 2023-07-21 05:10:29,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:29,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:29,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:29,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. service=AccessControlService 2023-07-21 05:10:29,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:29,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:29,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:29,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:29,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:29,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:29,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:29,803 INFO [StoreOpener-eb5d7e68b2f15af066d4f71e9ea7734d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:29,803 INFO [StoreOpener-6ab6ca59433f5c4385ad080bef0d1630-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:29,804 DEBUG [StoreOpener-6ab6ca59433f5c4385ad080bef0d1630-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/cf 2023-07-21 05:10:29,804 DEBUG [StoreOpener-6ab6ca59433f5c4385ad080bef0d1630-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/cf 2023-07-21 05:10:29,804 DEBUG [StoreOpener-eb5d7e68b2f15af066d4f71e9ea7734d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/cf 2023-07-21 05:10:29,805 DEBUG [StoreOpener-eb5d7e68b2f15af066d4f71e9ea7734d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/cf 2023-07-21 05:10:29,805 INFO [StoreOpener-6ab6ca59433f5c4385ad080bef0d1630-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ab6ca59433f5c4385ad080bef0d1630 columnFamilyName cf 2023-07-21 05:10:29,805 INFO [StoreOpener-eb5d7e68b2f15af066d4f71e9ea7734d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eb5d7e68b2f15af066d4f71e9ea7734d columnFamilyName cf 2023-07-21 05:10:29,807 INFO [StoreOpener-eb5d7e68b2f15af066d4f71e9ea7734d-1] regionserver.HStore(310): Store=eb5d7e68b2f15af066d4f71e9ea7734d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:29,808 INFO [StoreOpener-6ab6ca59433f5c4385ad080bef0d1630-1] regionserver.HStore(310): Store=6ab6ca59433f5c4385ad080bef0d1630/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:29,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:29,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:29,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:29,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:29,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:29,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:29,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:29,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eb5d7e68b2f15af066d4f71e9ea7734d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65897717, jitterRate=-0.018047496676445007}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:29,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eb5d7e68b2f15af066d4f71e9ea7734d: 2023-07-21 05:10:29,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d., pid=31, masterSystemTime=1689916229790 2023-07-21 05:10:29,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:29,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ab6ca59433f5c4385ad080bef0d1630; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60412253, jitterRate=-0.09978727996349335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:29,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ab6ca59433f5c4385ad080bef0d1630: 2023-07-21 05:10:29,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:29,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:29,823 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=eb5d7e68b2f15af066d4f71e9ea7734d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:29,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630., pid=30, masterSystemTime=1689916229787 2023-07-21 05:10:29,823 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229823"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916229823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916229823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916229823"}]},"ts":"1689916229823"} 2023-07-21 05:10:29,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:29,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:29,828 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6ab6ca59433f5c4385ad080bef0d1630, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:29,830 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916229828"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916229828"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916229828"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916229828"}]},"ts":"1689916229828"} 2023-07-21 05:10:29,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-21 05:10:29,831 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure eb5d7e68b2f15af066d4f71e9ea7734d, server=jenkins-hbase4.apache.org,34259,1689916199459 in 190 msec 2023-07-21 05:10:29,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb5d7e68b2f15af066d4f71e9ea7734d, ASSIGN in 355 msec 2023-07-21 05:10:29,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-21 05:10:29,838 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 6ab6ca59433f5c4385ad080bef0d1630, server=jenkins-hbase4.apache.org,41899,1689916199499 in 198 msec 2023-07-21 05:10:29,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-21 05:10:29,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ab6ca59433f5c4385ad080bef0d1630, ASSIGN in 362 msec 2023-07-21 05:10:29,842 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:29,843 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916229842"}]},"ts":"1689916229842"} 2023-07-21 05:10:29,845 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 05:10:29,848 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:29,848 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-21 05:10:29,850 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:10:29,853 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,853 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,853 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,853 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:29,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:29,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:29,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:29,855 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:29,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 462 msec 2023-07-21 05:10:30,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-21 05:10:30,003 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-21 05:10:30,006 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-21 05:10:30,007 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:30,008 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:30,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:30,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916230025 (current time:1689916230025). 2023-07-21 05:10:30,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:30,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x3cfa3e1f to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:30,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48944d29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:30,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:30,036 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:30,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3cfa3e1f to 127.0.0.1:51418 2023-07-21 05:10:30,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:30,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x1d40c13d to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:30,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70270e4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:30,050 DEBUG [hconnection-0x1a30f864-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:30,051 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:30,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:30,057 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:30,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d40c13d to 127.0.0.1:51418 2023-07-21 05:10:30,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:30,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:10:30,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:30,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:30,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:30,063 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:30,064 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689916830064 2023-07-21 05:10:30,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:30,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 05:10:30,066 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:30,066 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:30,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:30,071 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:30,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-21 05:10:30,074 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:30,075 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689916830075 2023-07-21 05:10:30,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,088 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-21 05:10:30,088 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:30,089 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 05:10:30,089 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 05:10:30,090 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,090 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,091 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:30,091 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:30,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:30,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:30,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:30,091 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,091 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:30,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:30,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:30,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:30,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,092 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,092 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,092 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 05:10:30,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,092 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,093 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:30,093 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:30,093 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:30,093 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:30,095 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:30,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:30,096 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:30,097 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:30,097 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:30,097 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:30,099 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,099 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:30,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:30,111 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,111 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:30,111 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,111 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,111 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:30,111 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,112 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,112 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,112 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:30,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 05:10:30,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4daf1a92[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:30,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-21 05:10:30,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4daf1a92[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:30,115 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 05:10:30,115 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,116 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,116 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,116 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,117 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:30,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:30,117 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,117 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:30,117 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:30,117 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. started... 2023-07-21 05:10:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:10:30,119 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ab6ca59433f5c4385ad080bef0d1630: 2023-07-21 05:10:30,117 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:30,119 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. started... 2023-07-21 05:10:30,119 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,119 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:30,119 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eb5d7e68b2f15af066d4f71e9ea7734d: 2023-07-21 05:10:30,119 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:30,119 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,120 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:30,120 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:30,151 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. completed. 2023-07-21 05:10:30,151 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:30,151 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:30,151 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:30,151 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,151 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:30,151 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:10:30,154 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:30,154 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,154 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:30,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:30,154 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:10:30,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 05:10:30,166 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:30,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:30,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:30,168 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:30,368 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:30,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:30,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:30,369 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:10:30,549 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. completed. 2023-07-21 05:10:30,549 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:30,549 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:30,549 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:30,549 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,549 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:30,549 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:10:30,616 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:30,616 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,616 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:30,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:30,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:30,616 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:30,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:30,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:30,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:30,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41899,1689916199499': 2023-07-21 05:10:30,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 05:10:30,622 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-21 05:10:30,623 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:30,623 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:30,623 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,623 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:30,669 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:30,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:30,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:30,671 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 05:10:30,677 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,677 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,677 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,677 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:30,678 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,678 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:30,677 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:30,678 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:30,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:30,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,679 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,680 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:30,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,681 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,682 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,682 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,716 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,716 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:30,716 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:30,716 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:30,716 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:30,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:30,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:30,716 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:30,716 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:30,716 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:30,716 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:30,716 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:30,716 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:30,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:30,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:30,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:30,718 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,717 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-21 05:10:30,719 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:30,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,719 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:30,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:10:30,719 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,719 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:30,719 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:30,719 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,719 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 05:10:30,731 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 05:10:30,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,782 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:30,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689916230064Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689916230731 (+667 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689916230731Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689916230731Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689916230735 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689916230747 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689916230782 (+35 ms) 2023-07-21 05:10:30,785 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:30,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 719 msec 2023-07-21 05:10:31,171 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:31,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:31,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:31,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34259] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:31,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41899] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:31,183 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-21 05:10:31,183 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:31,183 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:31,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:31,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916231195 (current time:1689916231195). 2023-07-21 05:10:31,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:31,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x319ddc1d to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:31,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b68876f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:31,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:31,235 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:31,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x319ddc1d to 127.0.0.1:51418 2023-07-21 05:10:31,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:31,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x0a696ac5 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:31,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a779488, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:31,357 DEBUG [hconnection-0x439c2cac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:31,361 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:31,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:31,367 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:31,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a696ac5 to 127.0.0.1:51418 2023-07-21 05:10:31,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:31,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:10:31,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:31,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:31,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:31,372 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:31,373 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689916831373 2023-07-21 05:10:31,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:10:31,373 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-21 05:10:31,374 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:31,374 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:31,376 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:10:31,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:31,377 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-21 05:10:31,378 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:31,379 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689916831379 2023-07-21 05:10:31,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-21 05:10:31,396 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-21 05:10:31,396 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:31,397 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-21 05:10:31,397 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-21 05:10:31,447 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,447 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,475 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:31,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:31,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:31,476 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:31,516 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:31,516 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:31,516 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:31,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:31,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:31,516 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:31,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:31,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:31,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:31,516 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:31,517 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,517 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:31,517 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:31,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 05:10:31,518 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:31,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-21 05:10:31,518 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:31,518 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:31,518 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-21 05:10:31,520 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:31,520 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:31,520 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:31,521 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-21 05:10:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-21 05:10:31,522 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-21 05:10:31,601 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,676 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:31,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:31,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:31,678 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:10:31,693 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:31,693 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:31,693 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:31,693 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:31,693 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,694 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:31,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:31,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:31,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:31,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:31,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 05:10:31,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@114a2ab4[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:31,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:31,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:31,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:31,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-21 05:10:31,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@114a2ab4[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:31,706 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 05:10:31,706 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,770 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,770 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,770 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,770 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:31,770 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:31,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:31,771 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:31,771 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:31,771 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:31,771 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:31,771 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:31,771 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:31,771 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:31,771 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:10:31,771 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. started... 2023-07-21 05:10:31,771 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:10:31,771 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:31,771 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:31,771 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:31,771 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ab6ca59433f5c4385ad080bef0d1630 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-21 05:10:31,771 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. started... 2023-07-21 05:10:31,771 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2745): Flushing eb5d7e68b2f15af066d4f71e9ea7734d 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-21 05:10:31,805 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072188aaaa5a56a54beda62f6127b74f48f3 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072188aaaa5a56a54beda62f6127b74f48f3 2023-07-21 05:10:31,808 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072143a83864e5464314940eab1dcf13e384 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072143a83864e5464314940eab1dcf13e384 2023-07-21 05:10:31,825 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/.tmp/cf/1271667a4960465b9b788ba4ffaeace1 2023-07-21 05:10:31,831 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/.tmp/cf/6343a0e0c0434d8ebf2d92a54a7121ac 2023-07-21 05:10:31,837 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/.tmp/cf/1271667a4960465b9b788ba4ffaeace1 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/cf/1271667a4960465b9b788ba4ffaeace1 2023-07-21 05:10:31,839 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:31,839 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/.tmp/cf/6343a0e0c0434d8ebf2d92a54a7121ac as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/cf/6343a0e0c0434d8ebf2d92a54a7121ac 2023-07-21 05:10:31,839 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:31,839 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:31,845 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/cf/1271667a4960465b9b788ba4ffaeace1, entries=48, sequenceid=6, filesize=13.0 K 2023-07-21 05:10:31,846 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 6ab6ca59433f5c4385ad080bef0d1630 in 75ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:31,846 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-21 05:10:31,846 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ab6ca59433f5c4385ad080bef0d1630: 2023-07-21 05:10:31,847 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 05:10:31,847 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/cf/6343a0e0c0434d8ebf2d92a54a7121ac, entries=2, sequenceid=6, filesize=5.2 K 2023-07-21 05:10:31,847 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:31,847 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/cf/1271667a4960465b9b788ba4ffaeace1] hfiles 2023-07-21 05:10:31,847 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/cf/1271667a4960465b9b788ba4ffaeace1 for snapshot=snaptb0-testExportFileSystemState 2023-07-21 05:10:31,848 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for eb5d7e68b2f15af066d4f71e9ea7734d in 77ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:31,849 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eb5d7e68b2f15af066d4f71e9ea7734d: 2023-07-21 05:10:31,849 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 05:10:31,849 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:31,849 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/cf/6343a0e0c0434d8ebf2d92a54a7121ac] hfiles 2023-07-21 05:10:31,850 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/cf/6343a0e0c0434d8ebf2d92a54a7121ac for snapshot=snaptb0-testExportFileSystemState 2023-07-21 05:10:31,862 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. completed. 2023-07-21 05:10:31,862 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:31,862 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:31,862 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:31,862 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:31,862 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:31,862 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:10:31,865 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. completed. 2023-07-21 05:10:31,865 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:31,865 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:31,865 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:31,865 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:31,865 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-21 05:10:31,865 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:10:31,978 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:31,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:31,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:31,979 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-21 05:10:32,062 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:32,062 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,062 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:32,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,063 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:32,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:32,139 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-21 05:10:32,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:32,139 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:32,139 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,139 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-21 05:10:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,41899,1689916199499': 2023-07-21 05:10:32,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 05:10:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:32,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:10:32,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 05:10:32,148 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-21 05:10:32,148 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:32,148 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:32,148 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-21 05:10:32,148 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:32,177 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,178 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:32,178 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,178 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:32,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,181 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,182 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:32,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:32,183 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-21 05:10:32,184 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,184 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,231 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,232 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:32,232 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:32,232 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,231 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:32,232 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:32,232 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-21 05:10:32,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:32,232 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-21 05:10:32,232 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:32,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-21 05:10:32,232 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:10:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:32,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:32,232 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:32,232 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,232 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:32,234 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,234 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:32,234 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,234 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:32,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,234 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:32,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,234 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:32,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072188aaaa5a56a54beda62f6127b74f48f3, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072143a83864e5464314940eab1dcf13e384] mob files 2023-07-21 05:10:32,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072188aaaa5a56a54beda62f6127b74f48f3 2023-07-21 05:10:32,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072143a83864e5464314940eab1dcf13e384 2023-07-21 05:10:32,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-21 05:10:32,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,289 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-21 05:10:32,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,290 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689916231373Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689916232244 (+871 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689916232244Loading Region manifests for snaptb0-testExportFileSystemState at 1689916232244Writing data manifest for snaptb0-testExportFileSystemState at 1689916232248 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689916232256 (+8 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689916232289 (+33 ms) 2023-07-21 05:10:32,293 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-21 05:10:32,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 919 msec 2023-07-21 05:10:32,479 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:32,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:10:32,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:32,481 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481 2023-07-21 05:10:32,481 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40289, tgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481, rawTgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481, srcFsUri=hdfs://localhost:40289, srcDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:32,509 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:32,509 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-326960294_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,509 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13, snapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-21 05:10:32,526 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-21 05:10:32,580 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:32,581 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:32,581 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:32,581 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,496 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-7408641083596180452.jar 2023-07-21 05:10:33,496 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,497 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,566 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-84763138843144937.jar 2023-07-21 05:10:33,567 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,567 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,567 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,568 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,568 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,568 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:33,569 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:10:33,569 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:10:33,570 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:10:33,570 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:10:33,570 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:10:33,571 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:10:33,571 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:10:33,572 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:10:33,572 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:10:33,573 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:10:33,574 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:33,574 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:33,575 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:33,575 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:33,576 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:33,576 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:33,577 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:33,696 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0001_000001 (auth:SIMPLE) 2023-07-21 05:10:34,113 WARN [Listener at jenkins-hbase4.apache.org/42887] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:10:34,117 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-21 05:10:34,119 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-21 05:10:34,237 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:34,237 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:34,691 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:10:34,698 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0002_000001 (auth:SIMPLE) 2023-07-21 05:10:39,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0002_000001 (auth:SIMPLE) 2023-07-21 05:10:41,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0002_000001 (auth:SIMPLE) 2023-07-21 05:10:46,360 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:10:46,363 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:10:46,375 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-21 05:10:46,375 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:10:46,376 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:10:46,377 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 05:10:46,377 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 05:10:46,377 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 05:10:46,377 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-21 05:10:46,378 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-21 05:10:46,378 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916232481/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-21 05:10:46,386 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-21 05:10:46,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-21 05:10:46,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:46,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 05:10:46,392 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916246392"}]},"ts":"1689916246392"} 2023-07-21 05:10:46,394 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 05:10:46,396 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-21 05:10:46,397 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb5d7e68b2f15af066d4f71e9ea7734d, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ab6ca59433f5c4385ad080bef0d1630, UNASSIGN}] 2023-07-21 05:10:46,399 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb5d7e68b2f15af066d4f71e9ea7734d, UNASSIGN 2023-07-21 05:10:46,399 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ab6ca59433f5c4385ad080bef0d1630, UNASSIGN 2023-07-21 05:10:46,400 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6ab6ca59433f5c4385ad080bef0d1630, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:46,400 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=eb5d7e68b2f15af066d4f71e9ea7734d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:46,400 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916246400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916246400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916246400"}]},"ts":"1689916246400"} 2023-07-21 05:10:46,400 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916246400"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916246400"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916246400"}]},"ts":"1689916246400"} 2023-07-21 05:10:46,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 6ab6ca59433f5c4385ad080bef0d1630, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:10:46,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure eb5d7e68b2f15af066d4f71e9ea7734d, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:10:46,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 05:10:46,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:46,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ab6ca59433f5c4385ad080bef0d1630, disabling compactions & flushes 2023-07-21 05:10:46,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:46,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:46,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. after waiting 0 ms 2023-07-21 05:10:46,555 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:46,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:46,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eb5d7e68b2f15af066d4f71e9ea7734d, disabling compactions & flushes 2023-07-21 05:10:46,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:46,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:46,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. after waiting 0 ms 2023-07-21 05:10:46,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:46,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:10:46,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:10:46,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:46,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:10:46,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630. 2023-07-21 05:10:46,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ab6ca59433f5c4385ad080bef0d1630: 2023-07-21 05:10:46,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d. 2023-07-21 05:10:46,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eb5d7e68b2f15af066d4f71e9ea7734d: 2023-07-21 05:10:46,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:46,578 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6ab6ca59433f5c4385ad080bef0d1630, regionState=CLOSED 2023-07-21 05:10:46,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:46,579 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916246578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916246578"}]},"ts":"1689916246578"} 2023-07-21 05:10:46,579 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=eb5d7e68b2f15af066d4f71e9ea7734d, regionState=CLOSED 2023-07-21 05:10:46,579 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689916246579"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916246579"}]},"ts":"1689916246579"} 2023-07-21 05:10:46,588 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-21 05:10:46,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 6ab6ca59433f5c4385ad080bef0d1630, server=jenkins-hbase4.apache.org,41899,1689916199499 in 183 msec 2023-07-21 05:10:46,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-21 05:10:46,590 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure eb5d7e68b2f15af066d4f71e9ea7734d, server=jenkins-hbase4.apache.org,34259,1689916199459 in 184 msec 2023-07-21 05:10:46,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6ab6ca59433f5c4385ad080bef0d1630, UNASSIGN in 192 msec 2023-07-21 05:10:46,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-21 05:10:46,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=eb5d7e68b2f15af066d4f71e9ea7734d, UNASSIGN in 193 msec 2023-07-21 05:10:46,594 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916246594"}]},"ts":"1689916246594"} 2023-07-21 05:10:46,596 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 05:10:46,598 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-21 05:10:46,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 212 msec 2023-07-21 05:10:46,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-21 05:10:46,694 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-21 05:10:46,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-21 05:10:46,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:46,699 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:46,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-21 05:10:46,700 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:46,701 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-21 05:10:46,705 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:46,705 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:46,705 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:46,705 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:46,705 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:46,705 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:46,706 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 05:10:46,706 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 05:10:46,706 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-21 05:10:46,707 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:46,707 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:46,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-21 05:10:46,707 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:46,707 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:46,707 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-21 05:10:46,707 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:46,707 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:46,707 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:10:46,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 05:10:46,709 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/recovered.edits] 2023-07-21 05:10:46,709 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/recovered.edits] 2023-07-21 05:10:46,713 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/cf/1271667a4960465b9b788ba4ffaeace1 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/cf/1271667a4960465b9b788ba4ffaeace1 2023-07-21 05:10:46,713 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/cf/6343a0e0c0434d8ebf2d92a54a7121ac to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/cf/6343a0e0c0434d8ebf2d92a54a7121ac 2023-07-21 05:10:46,716 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630/recovered.edits/9.seqid 2023-07-21 05:10:46,717 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d/recovered.edits/9.seqid 2023-07-21 05:10:46,717 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/6ab6ca59433f5c4385ad080bef0d1630 2023-07-21 05:10:46,717 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemState/eb5d7e68b2f15af066d4f71e9ea7734d 2023-07-21 05:10:46,717 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-21 05:10:46,718 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-21 05:10:46,719 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-21 05:10:46,722 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072188aaaa5a56a54beda62f6127b74f48f3 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072188aaaa5a56a54beda62f6127b74f48f3 2023-07-21 05:10:46,723 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072143a83864e5464314940eab1dcf13e384 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072143a83864e5464314940eab1dcf13e384 2023-07-21 05:10:46,723 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-21 05:10:46,726 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:46,728 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-21 05:10:46,731 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-21 05:10:46,732 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:46,732 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-21 05:10:46,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916246732"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:46,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916246732"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:46,734 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:10:46,734 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => eb5d7e68b2f15af066d4f71e9ea7734d, NAME => 'testtb-testExportFileSystemState,,1689916229391.eb5d7e68b2f15af066d4f71e9ea7734d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6ab6ca59433f5c4385ad080bef0d1630, NAME => 'testtb-testExportFileSystemState,1,1689916229391.6ab6ca59433f5c4385ad080bef0d1630.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:10:46,734 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-21 05:10:46,734 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916246734"}]},"ts":"9223372036854775807"} 2023-07-21 05:10:46,736 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-21 05:10:46,738 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-21 05:10:46,742 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-07-21 05:10:46,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-21 05:10:46,810 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-21 05:10:46,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-21 05:10:46,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-21 05:10:46,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-21 05:10:46,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-21 05:10:46,849 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=757 (was 750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1915921609) connection to jenkins-hbase4.apache.org/172.31.14.131:35061 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-843189767_1 at /127.0.0.1:42774 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:34104 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2018 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:55330 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-843189767_1 at /127.0.0.1:55314 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:42800 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=455 (was 376) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2512 (was 2749) 2023-07-21 05:10:46,849 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-21 05:10:46,869 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=757, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=455, ProcessCount=183, AvailableMemoryMB=2512 2023-07-21 05:10:46,869 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-21 05:10:46,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 05:10:46,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:10:46,874 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:10:46,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-21 05:10:46,875 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:10:46,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 05:10:46,878 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:10:46,878 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:10:46,879 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6 empty. 2023-07-21 05:10:46,879 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd empty. 2023-07-21 05:10:46,879 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:10:46,879 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:10:46,879 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 05:10:46,896 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-21 05:10:46,898 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3fa6ffb29f309df9470fa7099c188bcd, NAME => 'testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:10:46,898 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9fe367b079560477f10bf12a37d1c7f6, NAME => 'testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 3fa6ffb29f309df9470fa7099c188bcd, disabling compactions & flushes 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 9fe367b079560477f10bf12a37d1c7f6, disabling compactions & flushes 2023-07-21 05:10:46,914 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:46,914 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. after waiting 0 ms 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. after waiting 0 ms 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:46,914 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:46,914 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 9fe367b079560477f10bf12a37d1c7f6: 2023-07-21 05:10:46,914 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 3fa6ffb29f309df9470fa7099c188bcd: 2023-07-21 05:10:46,917 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:10:46,919 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916246918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916246918"}]},"ts":"1689916246918"} 2023-07-21 05:10:46,919 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916246918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916246918"}]},"ts":"1689916246918"} 2023-07-21 05:10:46,921 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:10:46,922 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:10:46,922 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916246922"}]},"ts":"1689916246922"} 2023-07-21 05:10:46,924 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-21 05:10:46,927 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:10:46,928 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:10:46,928 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:10:46,929 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:10:46,929 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:10:46,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fe367b079560477f10bf12a37d1c7f6, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3fa6ffb29f309df9470fa7099c188bcd, ASSIGN}] 2023-07-21 05:10:46,933 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3fa6ffb29f309df9470fa7099c188bcd, ASSIGN 2023-07-21 05:10:46,933 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fe367b079560477f10bf12a37d1c7f6, ASSIGN 2023-07-21 05:10:46,934 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fe367b079560477f10bf12a37d1c7f6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42011,1689916199401; forceNewPlan=false, retain=false 2023-07-21 05:10:46,934 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3fa6ffb29f309df9470fa7099c188bcd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34259,1689916199459; forceNewPlan=false, retain=false 2023-07-21 05:10:46,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 05:10:47,084 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:10:47,087 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3fa6ffb29f309df9470fa7099c188bcd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,087 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9fe367b079560477f10bf12a37d1c7f6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,087 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247087"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916247087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916247087"}]},"ts":"1689916247087"} 2023-07-21 05:10:47,087 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247087"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916247087"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916247087"}]},"ts":"1689916247087"} 2023-07-21 05:10:47,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 3fa6ffb29f309df9470fa7099c188bcd, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:10:47,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 9fe367b079560477f10bf12a37d1c7f6, server=jenkins-hbase4.apache.org,42011,1689916199401}] 2023-07-21 05:10:47,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 05:10:47,249 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:47,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3fa6ffb29f309df9470fa7099c188bcd, NAME => 'testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:10:47,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. service=AccessControlService 2023-07-21 05:10:47,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:47,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:10:47,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:47,250 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:47,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:10:47,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:10:47,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9fe367b079560477f10bf12a37d1c7f6, NAME => 'testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:10:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. service=AccessControlService 2023-07-21 05:10:47,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:10:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:10:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:10:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:10:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:10:47,252 INFO [StoreOpener-3fa6ffb29f309df9470fa7099c188bcd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:10:47,252 INFO [StoreOpener-9fe367b079560477f10bf12a37d1c7f6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:10:47,253 DEBUG [StoreOpener-3fa6ffb29f309df9470fa7099c188bcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/cf 2023-07-21 05:10:47,253 DEBUG [StoreOpener-3fa6ffb29f309df9470fa7099c188bcd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/cf 2023-07-21 05:10:47,254 INFO [StoreOpener-3fa6ffb29f309df9470fa7099c188bcd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fa6ffb29f309df9470fa7099c188bcd columnFamilyName cf 2023-07-21 05:10:47,254 DEBUG [StoreOpener-9fe367b079560477f10bf12a37d1c7f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/cf 2023-07-21 05:10:47,254 DEBUG [StoreOpener-9fe367b079560477f10bf12a37d1c7f6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/cf 2023-07-21 05:10:47,254 INFO [StoreOpener-9fe367b079560477f10bf12a37d1c7f6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fe367b079560477f10bf12a37d1c7f6 columnFamilyName cf 2023-07-21 05:10:47,255 INFO [StoreOpener-3fa6ffb29f309df9470fa7099c188bcd-1] regionserver.HStore(310): Store=3fa6ffb29f309df9470fa7099c188bcd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:47,256 INFO [StoreOpener-9fe367b079560477f10bf12a37d1c7f6-1] regionserver.HStore(310): Store=9fe367b079560477f10bf12a37d1c7f6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:10:47,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:10:47,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:10:47,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:10:47,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:10:47,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:10:47,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:10:47,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:47,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3fa6ffb29f309df9470fa7099c188bcd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72228318, jitterRate=0.07628580927848816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:47,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3fa6ffb29f309df9470fa7099c188bcd: 2023-07-21 05:10:47,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:10:47,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9fe367b079560477f10bf12a37d1c7f6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72442819, jitterRate=0.07948212325572968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:10:47,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9fe367b079560477f10bf12a37d1c7f6: 2023-07-21 05:10:47,265 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6., pid=46, masterSystemTime=1689916247244 2023-07-21 05:10:47,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd., pid=45, masterSystemTime=1689916247243 2023-07-21 05:10:47,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:47,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:47,272 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=9fe367b079560477f10bf12a37d1c7f6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:47,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:47,273 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247272"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916247272"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916247272"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916247272"}]},"ts":"1689916247272"} 2023-07-21 05:10:47,275 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3fa6ffb29f309df9470fa7099c188bcd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,275 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916247274"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916247274"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916247274"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916247274"}]},"ts":"1689916247274"} 2023-07-21 05:10:47,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-21 05:10:47,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 9fe367b079560477f10bf12a37d1c7f6, server=jenkins-hbase4.apache.org,42011,1689916199401 in 184 msec 2023-07-21 05:10:47,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-21 05:10:47,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fe367b079560477f10bf12a37d1c7f6, ASSIGN in 352 msec 2023-07-21 05:10:47,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 3fa6ffb29f309df9470fa7099c188bcd, server=jenkins-hbase4.apache.org,34259,1689916199459 in 190 msec 2023-07-21 05:10:47,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-21 05:10:47,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3fa6ffb29f309df9470fa7099c188bcd, ASSIGN in 354 msec 2023-07-21 05:10:47,287 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:10:47,287 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916247287"}]},"ts":"1689916247287"} 2023-07-21 05:10:47,289 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-21 05:10:47,292 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:10:47,292 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-21 05:10:47,294 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 05:10:47,301 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,301 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,301 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,302 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:10:47,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:47,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:47,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:47,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-21 05:10:47,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 432 msec 2023-07-21 05:10:47,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-21 05:10:47,480 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-21 05:10:47,486 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-21 05:10:47,486 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:47,489 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:47,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:47,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916247504 (current time:1689916247504). 2023-07-21 05:10:47,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:47,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x238dcd5e to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:47,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41c614b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:47,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:47,517 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:47,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x238dcd5e to 127.0.0.1:51418 2023-07-21 05:10:47,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:47,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x0b65a561 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:47,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@464f6e6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:47,534 DEBUG [hconnection-0x375dd1cb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:47,538 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:47,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:47,545 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:47,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b65a561 to 127.0.0.1:51418 2023-07-21 05:10:47,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:47,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 05:10:47,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:47,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:47,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:47,552 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:47,553 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689916847553 2023-07-21 05:10:47,553 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 05:10:47,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:47,556 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:47,556 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:47,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:47,560 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:47,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-21 05:10:47,563 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:47,564 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689916847564 2023-07-21 05:10:47,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,574 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-21 05:10:47,574 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:47,575 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 05:10:47,575 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 05:10:47,575 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,576 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,577 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,577 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:47,577 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:47,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:47,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:47,577 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:47,577 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:47,577 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,578 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,578 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 05:10:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-21 05:10:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,579 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:47,579 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:47,579 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:47,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,580 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,580 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:47,580 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:47,580 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:47,581 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:47,581 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:47,581 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:47,581 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:47,580 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:47,581 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:47,581 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:47,584 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:47,585 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:47,585 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:47,586 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,586 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:47,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:47,588 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,588 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,588 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,588 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:47,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:47,588 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,588 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,588 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:47,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:47,589 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,589 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:47,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:47,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 05:10:47,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52a9d3d9[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:47,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:47,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:47,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:47,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:47,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:47,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-21 05:10:47,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52a9d3d9[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:47,592 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 05:10:47,592 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:47,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:47,594 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:10:47,594 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. started... 2023-07-21 05:10:47,594 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,594 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:47,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:47,594 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:47,594 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9fe367b079560477f10bf12a37d1c7f6: 2023-07-21 05:10:47,595 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:47,595 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:47,595 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:47,595 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,595 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. started... 2023-07-21 05:10:47,596 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:47,596 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:47,597 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3fa6ffb29f309df9470fa7099c188bcd: 2023-07-21 05:10:47,597 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,597 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:47,597 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:10:47,599 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:47,599 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:47,599 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:47,612 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. completed. 2023-07-21 05:10:47,612 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. completed. 2023-07-21 05:10:47,612 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:47,612 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:10:47,612 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:10:47,615 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:47,615 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:47,615 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:47,615 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,615 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:47,616 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,615 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:47,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:47,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:47,616 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:47,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:47,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:47,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42011,1689916199401': 2023-07-21 05:10:47,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 05:10:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:47,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:10:47,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 05:10:47,624 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-21 05:10:47,624 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:47,624 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:47,624 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,624 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:47,626 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:47,626 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:47,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:47,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:47,626 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:47,626 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:47,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,627 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,628 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:47,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,630 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:47,630 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,630 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,633 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,633 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:47,633 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:47,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:47,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:47,633 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:47,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,633 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-21 05:10:47,634 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,633 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:47,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,633 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:47,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:47,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:47,633 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:47,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:47,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:10:47,635 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,635 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:47,635 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:47,635 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:47,635 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:47,635 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,635 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:47,635 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,636 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 05:10:47,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,656 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:47,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 05:10:47,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:47,657 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:47,664 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 05:10:47,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,688 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-21 05:10:47,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689916247553Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689916247644 (+91 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689916247644Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689916247644Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689916247647 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689916247658 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689916247687 (+29 ms) 2023-07-21 05:10:47,693 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:47,694 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 139 msec 2023-07-21 05:10:47,857 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:47,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 05:10:47,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:47,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42011] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:47,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34259] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:10:47,866 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-21 05:10:47,866 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:47,867 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:10:47,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:47,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916247882 (current time:1689916247882). 2023-07-21 05:10:47,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:10:47,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x3a671e30 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:47,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a2228a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:47,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:47,919 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:47,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a671e30 to 127.0.0.1:51418 2023-07-21 05:10:47,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:47,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x41030eae to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:10:47,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43171e20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:10:47,933 DEBUG [hconnection-0x182b61f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:47,934 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:47,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:10:47,941 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:10:47,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41030eae to 127.0.0.1:51418 2023-07-21 05:10:47,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:10:47,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-21 05:10:47,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:10:47,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:47,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:47,947 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:47,948 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689916847948 2023-07-21 05:10:47,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-21 05:10:47,948 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-21 05:10:47,949 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:10:47,950 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:10:47,951 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-21 05:10:47,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:47,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-21 05:10:47,953 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:47,954 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689916847954 2023-07-21 05:10:47,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-21 05:10:47,969 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-21 05:10:47,969 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:47,972 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-21 05:10:47,972 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-21 05:10:47,980 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,980 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,982 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,982 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:47,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:47,982 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:47,982 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:47,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:47,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:47,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:47,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:47,987 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:47,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,987 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,988 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:47,988 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:10:47,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 05:10:47,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 05:10:47,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-21 05:10:47,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:47,988 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:47,988 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:47,988 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-21 05:10:47,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 05:10:47,991 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:47,991 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:47,991 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 05:10:47,991 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:47,991 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,000 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:48,001 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:48,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-21 05:10:48,000 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:48,001 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-21 05:10:48,001 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:48,001 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:48,001 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:48,001 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:10:48,003 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-21 05:10:48,003 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-21 05:10:48,003 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-21 05:10:48,006 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,006 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,006 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,006 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,007 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:10:48,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 05:10:48,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51d2bfe6[Count = 1] remaining members to acquire global barrier 2023-07-21 05:10:48,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-21 05:10:48,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51d2bfe6[Count = 0] remaining members to acquire global barrier 2023-07-21 05:10:48,015 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-21 05:10:48,015 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,016 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,016 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,016 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,017 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:48,017 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:48,017 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:48,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,017 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:10:48,017 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-21 05:10:48,017 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,018 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,018 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:10:48,019 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:48,019 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,019 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:48,021 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:48,022 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:48,022 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:48,022 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:48,022 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. started... 2023-07-21 05:10:48,022 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:10:48,022 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:10:48,022 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. started... 2023-07-21 05:10:48,022 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9fe367b079560477f10bf12a37d1c7f6 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-21 05:10:48,022 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3fa6ffb29f309df9470fa7099c188bcd 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-21 05:10:48,050 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:48,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 05:10:48,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:48,052 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:10:48,058 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307215af5803d086746ecaacb86455f53585f to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307215af5803d086746ecaacb86455f53585f 2023-07-21 05:10:48,062 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307218df7488c77f14068bedf2ffb19491f95 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307218df7488c77f14068bedf2ffb19491f95 2023-07-21 05:10:48,070 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/.tmp/cf/e274af565efd455ab20f9acd931e0db2 2023-07-21 05:10:48,078 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/.tmp/cf/1ca3bb35ec3b497894815dfc783e96e8 2023-07-21 05:10:48,079 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/.tmp/cf/e274af565efd455ab20f9acd931e0db2 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/cf/e274af565efd455ab20f9acd931e0db2 2023-07-21 05:10:48,085 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/.tmp/cf/1ca3bb35ec3b497894815dfc783e96e8 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/cf/1ca3bb35ec3b497894815dfc783e96e8 2023-07-21 05:10:48,091 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/cf/e274af565efd455ab20f9acd931e0db2, entries=4, sequenceid=6, filesize=5.6 K 2023-07-21 05:10:48,092 INFO [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 9fe367b079560477f10bf12a37d1c7f6 in 70ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:48,092 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-21 05:10:48,092 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/cf/1ca3bb35ec3b497894815dfc783e96e8, entries=46, sequenceid=6, filesize=12.5 K 2023-07-21 05:10:48,092 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9fe367b079560477f10bf12a37d1c7f6: 2023-07-21 05:10:48,093 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 05:10:48,093 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:48,093 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/cf/e274af565efd455ab20f9acd931e0db2] hfiles 2023-07-21 05:10:48,093 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/cf/e274af565efd455ab20f9acd931e0db2 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 05:10:48,094 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 3fa6ffb29f309df9470fa7099c188bcd in 72ms, sequenceid=6, compaction requested=false 2023-07-21 05:10:48,098 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3fa6ffb29f309df9470fa7099c188bcd: 2023-07-21 05:10:48,099 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 05:10:48,099 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:10:48,099 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/cf/1ca3bb35ec3b497894815dfc783e96e8] hfiles 2023-07-21 05:10:48,099 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/cf/1ca3bb35ec3b497894815dfc783e96e8 for snapshot=snaptb0-testConsecutiveExports 2023-07-21 05:10:48,114 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. completed. 2023-07-21 05:10:48,114 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:10:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:10:48,117 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:48,117 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,117 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,117 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:10:48,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-21 05:10:48,140 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. completed. 2023-07-21 05:10:48,140 DEBUG [rs(jenkins-hbase4.apache.org,42011,1689916199401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:10:48,141 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:10:48,141 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:10:48,141 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,141 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-21 05:10:48,141 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:10:48,143 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,143 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-21 05:10:48,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,143 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,143 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-21 05:10:48,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42011,1689916199401': 2023-07-21 05:10:48,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-21 05:10:48,153 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-21 05:10:48,153 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:10:48,153 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:10:48,153 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-21 05:10:48,153 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:10:48,155 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,155 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,155 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,155 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,155 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,155 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:10:48,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:10:48,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,156 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:10:48,159 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,159 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:10:48,160 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:10:48,162 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,162 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-21 05:10:48,163 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:10:48,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:10:48,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,170 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:10:48,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-21 05:10:48,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-21 05:10:48,170 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:10:48,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,173 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,174 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:10:48,174 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:10:48,174 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,174 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-21 05:10:48,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:10:48,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:10:48,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:10:48,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:10:48,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:10:48,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307218df7488c77f14068bedf2ffb19491f95, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307215af5803d086746ecaacb86455f53585f] mob files 2023-07-21 05:10:48,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307218df7488c77f14068bedf2ffb19491f95 2023-07-21 05:10:48,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307215af5803d086746ecaacb86455f53585f 2023-07-21 05:10:48,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-21 05:10:48,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,252 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:48,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 05:10:48,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:10:48,254 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:10:48,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-21 05:10:48,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689916247948Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689916248197 (+249 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689916248197Loading Region manifests for snaptb0-testConsecutiveExports at 1689916248197Writing data manifest for snaptb0-testConsecutiveExports at 1689916248211 (+14 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689916248223 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689916248256 (+33 ms) 2023-07-21 05:10:48,260 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-21 05:10:48,263 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 311 msec 2023-07-21 05:10:48,554 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:10:48,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-21 05:10:48,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:10:48,556 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555 2023-07-21 05:10:48,556 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555, srcFsUri=hdfs://localhost:40289, srcDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:48,583 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:10:48,583 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@74dcdfc2, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,583 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13, snapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 05:10:48,599 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:10:48,616 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:48,617 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:48,617 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:48,618 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,565 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-4367287998795218755.jar 2023-07-21 05:10:49,565 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,566 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,636 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-4800357056725824099.jar 2023-07-21 05:10:49,636 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,637 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,637 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,637 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,638 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,638 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:10:49,638 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:10:49,639 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:10:49,639 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:10:49,639 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:10:49,640 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:10:49,640 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:10:49,641 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:10:49,641 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:10:49,641 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:10:49,642 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:10:49,642 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:49,643 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:49,643 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:49,644 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:49,644 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:10:49,645 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:49,645 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:10:50,084 WARN [Listener at jenkins-hbase4.apache.org/42887] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:10:50,087 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 05:10:50,089 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-21 05:10:50,696 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:50,696 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:10:50,701 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0002_000001 (auth:SIMPLE) 2023-07-21 05:10:50,782 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0003_000001 (auth:SIMPLE) 2023-07-21 05:10:52,158 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:10:54,970 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0003_000001 (auth:SIMPLE) 2023-07-21 05:10:57,284 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0003_000001 (auth:SIMPLE) 2023-07-21 05:11:00,819 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0003_000001 (auth:SIMPLE) 2023-07-21 05:11:02,286 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:11:02,286 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:11:02,290 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 05:11:02,290 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:11:02,291 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:11:02,291 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:11:02,292 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 05:11:02,292 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 05:11:02,292 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c79a990 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:11:02,292 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 05:11:02,292 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 05:11:02,294 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555, srcFsUri=hdfs://localhost:40289, srcDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:11:02,316 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:11:02,316 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@243feeba, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:11:02,317 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13, snapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-21 05:11:02,326 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-21 05:11:02,338 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:02,338 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:02,338 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:02,339 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:03,226 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-8273637835513950975.jar 2023-07-21 05:11:03,227 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:03,227 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:03,293 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-5201643997708598491.jar 2023-07-21 05:11:03,294 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:03,294 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:03,295 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:03,295 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:03,295 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:03,296 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:03,296 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:11:03,296 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:11:03,297 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:11:03,297 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:11:03,298 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:11:03,298 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:11:03,298 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:11:03,299 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:11:03,299 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:11:03,300 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:11:03,300 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:03,301 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:03,301 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:03,301 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:03,302 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:03,302 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:03,303 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:03,772 WARN [Listener at jenkins-hbase4.apache.org/42887] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:11:03,775 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-21 05:11:03,778 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-21 05:11:07,007 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:07,007 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:07,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0003_000001 (auth:SIMPLE) 2023-07-21 05:11:07,380 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:13,068 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:15,425 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:18,785 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:20,048 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:11:20,048 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:11:20,055 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-21 05:11:20,055 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:11:20,056 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:11:20,056 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:11:20,059 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 05:11:20,059 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 05:11:20,059 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c79a990 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-21 05:11:20,059 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-21 05:11:20,059 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/local-export-1689916248555/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-21 05:11:20,075 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-21 05:11:20,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-21 05:11:20,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:20,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 05:11:20,087 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916280086"}]},"ts":"1689916280086"} 2023-07-21 05:11:20,089 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-21 05:11:20,091 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-21 05:11:20,092 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fe367b079560477f10bf12a37d1c7f6, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3fa6ffb29f309df9470fa7099c188bcd, UNASSIGN}] 2023-07-21 05:11:20,095 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fe367b079560477f10bf12a37d1c7f6, UNASSIGN 2023-07-21 05:11:20,095 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3fa6ffb29f309df9470fa7099c188bcd, UNASSIGN 2023-07-21 05:11:20,096 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9fe367b079560477f10bf12a37d1c7f6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:20,096 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916280096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916280096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916280096"}]},"ts":"1689916280096"} 2023-07-21 05:11:20,097 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3fa6ffb29f309df9470fa7099c188bcd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:20,097 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916280097"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916280097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916280097"}]},"ts":"1689916280097"} 2023-07-21 05:11:20,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 3fa6ffb29f309df9470fa7099c188bcd, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:11:20,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 9fe367b079560477f10bf12a37d1c7f6, server=jenkins-hbase4.apache.org,42011,1689916199401}] 2023-07-21 05:11:20,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 05:11:20,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:11:20,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3fa6ffb29f309df9470fa7099c188bcd, disabling compactions & flushes 2023-07-21 05:11:20,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:11:20,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:11:20,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. after waiting 0 ms 2023-07-21 05:11:20,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:11:20,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:11:20,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9fe367b079560477f10bf12a37d1c7f6, disabling compactions & flushes 2023-07-21 05:11:20,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:11:20,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:11:20,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. after waiting 0 ms 2023-07-21 05:11:20,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:11:20,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:20,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:20,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd. 2023-07-21 05:11:20,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3fa6ffb29f309df9470fa7099c188bcd: 2023-07-21 05:11:20,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:11:20,318 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3fa6ffb29f309df9470fa7099c188bcd, regionState=CLOSED 2023-07-21 05:11:20,318 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916280318"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916280318"}]},"ts":"1689916280318"} 2023-07-21 05:11:20,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-21 05:11:20,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 3fa6ffb29f309df9470fa7099c188bcd, server=jenkins-hbase4.apache.org,34259,1689916199459 in 221 msec 2023-07-21 05:11:20,330 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3fa6ffb29f309df9470fa7099c188bcd, UNASSIGN in 230 msec 2023-07-21 05:11:20,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:20,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:20,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6. 2023-07-21 05:11:20,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9fe367b079560477f10bf12a37d1c7f6: 2023-07-21 05:11:20,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:11:20,352 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=9fe367b079560477f10bf12a37d1c7f6, regionState=CLOSED 2023-07-21 05:11:20,352 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689916280352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916280352"}]},"ts":"1689916280352"} 2023-07-21 05:11:20,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-21 05:11:20,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 9fe367b079560477f10bf12a37d1c7f6, server=jenkins-hbase4.apache.org,42011,1689916199401 in 251 msec 2023-07-21 05:11:20,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-21 05:11:20,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9fe367b079560477f10bf12a37d1c7f6, UNASSIGN in 264 msec 2023-07-21 05:11:20,360 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916280360"}]},"ts":"1689916280360"} 2023-07-21 05:11:20,362 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-21 05:11:20,364 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-21 05:11:20,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 289 msec 2023-07-21 05:11:20,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-21 05:11:20,389 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-21 05:11:20,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-21 05:11:20,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:20,405 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:20,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-21 05:11:20,407 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:20,411 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-21 05:11:20,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:20,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:20,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:20,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:20,416 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 05:11:20,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 05:11:20,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-21 05:11:20,418 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:20,418 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-21 05:11:20,418 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:20,418 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:20,418 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:11:20,418 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-21 05:11:20,418 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:20,418 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:20,418 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:20,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 05:11:20,429 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:11:20,431 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:11:20,433 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/recovered.edits] 2023-07-21 05:11:20,436 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/recovered.edits] 2023-07-21 05:11:20,446 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/cf/e274af565efd455ab20f9acd931e0db2 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/cf/e274af565efd455ab20f9acd931e0db2 2023-07-21 05:11:20,460 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/cf/1ca3bb35ec3b497894815dfc783e96e8 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/cf/1ca3bb35ec3b497894815dfc783e96e8 2023-07-21 05:11:20,470 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6/recovered.edits/9.seqid 2023-07-21 05:11:20,470 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/9fe367b079560477f10bf12a37d1c7f6 2023-07-21 05:11:20,471 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd/recovered.edits/9.seqid 2023-07-21 05:11:20,472 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testConsecutiveExports/3fa6ffb29f309df9470fa7099c188bcd 2023-07-21 05:11:20,472 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-21 05:11:20,473 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-21 05:11:20,479 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-21 05:11:20,486 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307218df7488c77f14068bedf2ffb19491f95 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307218df7488c77f14068bedf2ffb19491f95 2023-07-21 05:11:20,487 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307215af5803d086746ecaacb86455f53585f to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307215af5803d086746ecaacb86455f53585f 2023-07-21 05:11:20,488 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-21 05:11:20,491 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:20,512 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-21 05:11:20,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 05:11:20,523 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-21 05:11:20,525 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:20,525 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-21 05:11:20,526 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916280525"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:20,526 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916280525"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:20,531 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:11:20,531 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9fe367b079560477f10bf12a37d1c7f6, NAME => 'testtb-testConsecutiveExports,,1689916246870.9fe367b079560477f10bf12a37d1c7f6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3fa6ffb29f309df9470fa7099c188bcd, NAME => 'testtb-testConsecutiveExports,1,1689916246870.3fa6ffb29f309df9470fa7099c188bcd.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:11:20,531 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-21 05:11:20,532 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916280531"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:20,535 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-21 05:11:20,541 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-21 05:11:20,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 151 msec 2023-07-21 05:11:20,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-21 05:11:20,723 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-21 05:11:20,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-21 05:11:20,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-21 05:11:20,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-21 05:11:20,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-21 05:11:20,809 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=743 (was 757), OpenFileDescriptor=891 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=476 (was 455) - SystemLoadAverage LEAK? -, ProcessCount=188 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=1784 (was 2512) 2023-07-21 05:11:20,809 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-21 05:11:20,834 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=743, OpenFileDescriptor=891, MaxFileDescriptor=60000, SystemLoadAverage=476, ProcessCount=188, AvailableMemoryMB=1782 2023-07-21 05:11:20,834 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=743 is superior to 500 2023-07-21 05:11:20,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 05:11:20,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:20,841 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:11:20,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-21 05:11:20,842 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:11:20,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 05:11:20,845 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:20,846 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:20,846 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a empty. 2023-07-21 05:11:20,846 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139 empty. 2023-07-21 05:11:20,847 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:20,847 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:20,847 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 05:11:20,895 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-21 05:11:20,905 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => ea5e82e0f86611c32c29842e652c181a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:11:20,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2fbfa0d06f4e5018a9858f207a7a1139, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:11:20,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 05:11:21,035 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:21,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing ea5e82e0f86611c32c29842e652c181a, disabling compactions & flushes 2023-07-21 05:11:21,036 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:21,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:21,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. after waiting 0 ms 2023-07-21 05:11:21,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:21,036 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:21,036 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for ea5e82e0f86611c32c29842e652c181a: 2023-07-21 05:11:21,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:21,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 2fbfa0d06f4e5018a9858f207a7a1139, disabling compactions & flushes 2023-07-21 05:11:21,038 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:21,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:21,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. after waiting 0 ms 2023-07-21 05:11:21,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:21,038 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:21,038 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 2fbfa0d06f4e5018a9858f207a7a1139: 2023-07-21 05:11:21,047 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:11:21,048 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916281048"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916281048"}]},"ts":"1689916281048"} 2023-07-21 05:11:21,048 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916281048"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916281048"}]},"ts":"1689916281048"} 2023-07-21 05:11:21,065 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:11:21,067 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:11:21,067 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916281067"}]},"ts":"1689916281067"} 2023-07-21 05:11:21,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-21 05:11:21,077 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:11:21,078 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:11:21,078 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:11:21,079 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:11:21,079 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:11:21,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ea5e82e0f86611c32c29842e652c181a, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fbfa0d06f4e5018a9858f207a7a1139, ASSIGN}] 2023-07-21 05:11:21,083 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ea5e82e0f86611c32c29842e652c181a, ASSIGN 2023-07-21 05:11:21,083 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fbfa0d06f4e5018a9858f207a7a1139, ASSIGN 2023-07-21 05:11:21,084 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ea5e82e0f86611c32c29842e652c181a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34259,1689916199459; forceNewPlan=false, retain=false 2023-07-21 05:11:21,085 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fbfa0d06f4e5018a9858f207a7a1139, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41899,1689916199499; forceNewPlan=false, retain=false 2023-07-21 05:11:21,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 05:11:21,235 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:11:21,239 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2fbfa0d06f4e5018a9858f207a7a1139, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:21,239 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ea5e82e0f86611c32c29842e652c181a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:21,239 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916281239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916281239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916281239"}]},"ts":"1689916281239"} 2023-07-21 05:11:21,239 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916281239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916281239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916281239"}]},"ts":"1689916281239"} 2023-07-21 05:11:21,242 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 2fbfa0d06f4e5018a9858f207a7a1139, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:11:21,246 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure ea5e82e0f86611c32c29842e652c181a, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:11:21,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:21,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2fbfa0d06f4e5018a9858f207a7a1139, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:11:21,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. service=AccessControlService 2023-07-21 05:11:21,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:21,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:21,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:21,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:21,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:21,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:21,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea5e82e0f86611c32c29842e652c181a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:11:21,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. service=AccessControlService 2023-07-21 05:11:21,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:21,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:21,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:21,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:21,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:21,415 INFO [StoreOpener-2fbfa0d06f4e5018a9858f207a7a1139-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:21,415 INFO [StoreOpener-ea5e82e0f86611c32c29842e652c181a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:21,418 DEBUG [StoreOpener-2fbfa0d06f4e5018a9858f207a7a1139-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/cf 2023-07-21 05:11:21,418 DEBUG [StoreOpener-2fbfa0d06f4e5018a9858f207a7a1139-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/cf 2023-07-21 05:11:21,420 INFO [StoreOpener-2fbfa0d06f4e5018a9858f207a7a1139-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fbfa0d06f4e5018a9858f207a7a1139 columnFamilyName cf 2023-07-21 05:11:21,420 DEBUG [StoreOpener-ea5e82e0f86611c32c29842e652c181a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/cf 2023-07-21 05:11:21,421 DEBUG [StoreOpener-ea5e82e0f86611c32c29842e652c181a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/cf 2023-07-21 05:11:21,421 INFO [StoreOpener-ea5e82e0f86611c32c29842e652c181a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea5e82e0f86611c32c29842e652c181a columnFamilyName cf 2023-07-21 05:11:21,423 INFO [StoreOpener-ea5e82e0f86611c32c29842e652c181a-1] regionserver.HStore(310): Store=ea5e82e0f86611c32c29842e652c181a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:21,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:21,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:21,426 INFO [StoreOpener-2fbfa0d06f4e5018a9858f207a7a1139-1] regionserver.HStore(310): Store=2fbfa0d06f4e5018a9858f207a7a1139/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:21,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:21,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:21,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:21,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:21,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea5e82e0f86611c32c29842e652c181a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73432897, jitterRate=0.09423543512821198}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:21,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea5e82e0f86611c32c29842e652c181a: 2023-07-21 05:11:21,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:21,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a., pid=61, masterSystemTime=1689916281401 2023-07-21 05:11:21,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:21,440 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ea5e82e0f86611c32c29842e652c181a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:21,441 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916281440"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916281440"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916281440"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916281440"}]},"ts":"1689916281440"} 2023-07-21 05:11:21,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:21,442 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:21,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2fbfa0d06f4e5018a9858f207a7a1139; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63302718, jitterRate=-0.05671599507331848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:21,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2fbfa0d06f4e5018a9858f207a7a1139: 2023-07-21 05:11:21,444 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139., pid=60, masterSystemTime=1689916281397 2023-07-21 05:11:21,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:21,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:21,446 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2fbfa0d06f4e5018a9858f207a7a1139, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:21,447 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916281446"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916281446"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916281446"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916281446"}]},"ts":"1689916281446"} 2023-07-21 05:11:21,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 05:11:21,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-21 05:11:21,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure ea5e82e0f86611c32c29842e652c181a, server=jenkins-hbase4.apache.org,34259,1689916199459 in 197 msec 2023-07-21 05:11:21,461 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ea5e82e0f86611c32c29842e652c181a, ASSIGN in 380 msec 2023-07-21 05:11:21,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-21 05:11:21,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 2fbfa0d06f4e5018a9858f207a7a1139, server=jenkins-hbase4.apache.org,41899,1689916199499 in 207 msec 2023-07-21 05:11:21,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-21 05:11:21,471 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fbfa0d06f4e5018a9858f207a7a1139, ASSIGN in 384 msec 2023-07-21 05:11:21,472 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:11:21,472 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916281472"}]},"ts":"1689916281472"} 2023-07-21 05:11:21,473 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-21 05:11:21,476 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:11:21,476 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-21 05:11:21,479 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 05:11:21,482 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:21,482 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:21,482 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:21,482 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:21,483 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:21,484 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:21,484 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:21,484 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:21,495 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 647 msec 2023-07-21 05:11:21,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-21 05:11:21,954 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-21 05:11:21,957 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:21,957 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:21,959 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:21,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:21,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916281982 (current time:1689916281982). 2023-07-21 05:11:21,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:21,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x1bb7136f to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:22,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@181a9982, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:22,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:22,006 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:22,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bb7136f to 127.0.0.1:51418 2023-07-21 05:11:22,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:22,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x507f10b0 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:22,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73f04dbb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:22,028 DEBUG [hconnection-0x3f6a1cce-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:22,031 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:22,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:22,038 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:22,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x507f10b0 to 127.0.0.1:51418 2023-07-21 05:11:22,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:22,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 05:11:22,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:22,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:22,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:22,044 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:22,046 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689916882046 2023-07-21 05:11:22,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:22,046 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,048 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:22,048 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:22,049 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:22,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:22,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-21 05:11:22,054 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:22,055 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689916882055 2023-07-21 05:11:22,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,077 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 05:11:22,077 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:22,078 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 05:11:22,078 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 05:11:22,144 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,144 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,146 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,146 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,146 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,146 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,146 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,146 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,147 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,147 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:22,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 05:11:22,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,147 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,147 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:22,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 05:11:22,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,148 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:22,148 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:22,148 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,148 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:22,148 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:22,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-21 05:11:22,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,148 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:22,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:22,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:22,149 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:22,149 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:22,150 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:22,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,155 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:22,157 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:22,159 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:22,159 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:22,159 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:22,161 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,161 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,161 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,164 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,164 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,164 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,164 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,164 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:22,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,164 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:22,164 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,164 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:22,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 05:11:22,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@641c44c4[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:22,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 05:11:22,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@641c44c4[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:22,175 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 05:11:22,175 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,177 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:22,177 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:22,177 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:11:22,177 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:22,178 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,178 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,178 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:22,179 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:22,179 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:22,179 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:22,179 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:22,180 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:22,180 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. started... 2023-07-21 05:11:22,180 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea5e82e0f86611c32c29842e652c181a: 2023-07-21 05:11:22,180 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,180 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:22,180 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:22,182 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:22,182 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:22,182 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:22,193 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:22,193 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. started... 2023-07-21 05:11:22,195 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fbfa0d06f4e5018a9858f207a7a1139: 2023-07-21 05:11:22,195 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,195 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:22,195 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:22,225 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. completed. 2023-07-21 05:11:22,225 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:22,225 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:22,225 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:22,225 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,225 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:22,225 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:11:22,227 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. completed. 2023-07-21 05:11:22,227 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:22,227 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:22,227 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:22,227 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,227 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:22,227 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:11:22,229 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:22,229 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:22,229 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,229 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:22,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,231 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:22,232 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:22,232 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,232 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:11:22,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 05:11:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41899,1689916199499': 2023-07-21 05:11:22,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 05:11:22,256 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 05:11:22,257 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:22,257 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:22,257 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,257 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:22,259 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,259 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,259 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,259 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,259 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,262 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,263 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,263 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,263 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,264 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,265 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,266 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,267 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,270 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,271 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,271 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,271 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,271 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,271 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,271 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,271 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,271 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,271 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,271 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:22,272 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,273 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,274 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,274 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,274 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,274 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,274 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,274 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:11:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 05:11:22,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,350 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:22,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:22,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:22,351 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:11:22,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,386 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 05:11:22,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,386 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689916282046Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689916282319 (+273 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689916282319Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689916282319Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689916282327 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689916282355 (+28 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689916282386 (+31 ms) 2023-07-21 05:11:22,390 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:22,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 342 msec 2023-07-21 05:11:22,651 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:22,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:22,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:22,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34259] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:22,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41899] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:22,664 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,664 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:22,664 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:22,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:22,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916282677 (current time:1689916282677). 2023-07-21 05:11:22,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:22,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x6d091f52 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:22,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12e7d31a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:22,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:22,691 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:22,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d091f52 to 127.0.0.1:51418 2023-07-21 05:11:22,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:22,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x03a8f323 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:22,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@267e9f8b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:22,698 DEBUG [hconnection-0xa2df75d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:22,702 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:22,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:22,709 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:22,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03a8f323 to 127.0.0.1:51418 2023-07-21 05:11:22,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:22,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-21 05:11:22,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:22,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:22,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:22,714 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:22,715 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689916882715 2023-07-21 05:11:22,715 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-21 05:11:22,717 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:22,717 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:22,718 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-21 05:11:22,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:22,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-21 05:11:22,720 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:22,723 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689916882723 2023-07-21 05:11:22,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,746 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-21 05:11:22,746 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:22,748 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-21 05:11:22,749 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-21 05:11:22,752 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,752 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,755 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,755 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,756 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,756 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,756 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,756 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,756 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,756 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:22,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 05:11:22,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:22,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 05:11:22,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-21 05:11:22,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:22,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,758 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:22,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-21 05:11:22,758 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:22,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,759 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:22,759 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:22,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-21 05:11:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:22,768 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:22,770 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-21 05:11:22,770 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-21 05:11:22,770 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-21 05:11:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,772 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,772 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,772 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:22,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 05:11:22,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2443cd79[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-21 05:11:22,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2443cd79[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:22,777 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-21 05:11:22,777 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:22,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,779 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:22,780 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-21 05:11:22,779 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,780 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:11:22,781 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,781 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:22,782 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:22,782 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:22,782 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:22,782 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:22,782 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:22,782 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:22,782 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:22,782 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:22,782 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:22,783 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. started... 2023-07-21 05:11:22,783 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. started... 2023-07-21 05:11:22,783 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ea5e82e0f86611c32c29842e652c181a 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-21 05:11:22,783 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2fbfa0d06f4e5018a9858f207a7a1139 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-21 05:11:22,817 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:22,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:22,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:22,819 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:22,840 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307219355ac47449449d9b12606908d9769de to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307219355ac47449449d9b12606908d9769de 2023-07-21 05:11:22,844 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230721242484f6fc274f0c80d35df815ee2299 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721242484f6fc274f0c80d35df815ee2299 2023-07-21 05:11:22,870 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/.tmp/cf/9a480e438db84d5e81693959bd2038fd 2023-07-21 05:11:22,877 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/.tmp/cf/9a480e438db84d5e81693959bd2038fd as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/cf/9a480e438db84d5e81693959bd2038fd 2023-07-21 05:11:22,879 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/.tmp/cf/a5c9971960514f88963f503506ed7aba 2023-07-21 05:11:22,886 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/.tmp/cf/a5c9971960514f88963f503506ed7aba as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/cf/a5c9971960514f88963f503506ed7aba 2023-07-21 05:11:22,887 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/cf/9a480e438db84d5e81693959bd2038fd, entries=4, sequenceid=6, filesize=5.6 K 2023-07-21 05:11:22,888 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for ea5e82e0f86611c32c29842e652c181a in 105ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:22,889 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-21 05:11:22,889 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea5e82e0f86611c32c29842e652c181a: 2023-07-21 05:11:22,889 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,889 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:22,890 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/cf/9a480e438db84d5e81693959bd2038fd] hfiles 2023-07-21 05:11:22,890 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/cf/9a480e438db84d5e81693959bd2038fd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,893 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/cf/a5c9971960514f88963f503506ed7aba, entries=46, sequenceid=6, filesize=13.3 K 2023-07-21 05:11:22,894 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2fbfa0d06f4e5018a9858f207a7a1139 in 111ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:22,896 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fbfa0d06f4e5018a9858f207a7a1139: 2023-07-21 05:11:22,896 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,898 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:22,898 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/cf/a5c9971960514f88963f503506ed7aba] hfiles 2023-07-21 05:11:22,898 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/cf/a5c9971960514f88963f503506ed7aba for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,923 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. completed. 2023-07-21 05:11:22,923 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:22,923 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:22,923 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:22,923 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,923 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:22,923 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:11:22,925 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,925 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:22,926 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,933 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. completed. 2023-07-21 05:11:22,933 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:22,933 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:22,933 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:22,933 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,933 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-21 05:11:22,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,933 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:11:22,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,935 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,935 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-21 05:11:22,935 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:22,935 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-21 05:11:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:11:22,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-21 05:11:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41899,1689916199499': 2023-07-21 05:11:22,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-21 05:11:22,942 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-21 05:11:22,942 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:22,942 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:22,942 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,942 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:22,947 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,947 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,947 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,947 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,947 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,948 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,948 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,948 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,949 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,949 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:22,953 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,953 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,953 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,959 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,959 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,959 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,959 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,959 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,959 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:22,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,959 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,959 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:22,960 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:11:22,962 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,959 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:22,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:22,962 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:22,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,962 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:22,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,962 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,962 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:22,962 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:22,962 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,962 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721242484f6fc274f0c80d35df815ee2299, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307219355ac47449449d9b12606908d9769de] mob files 2023-07-21 05:11:22,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:22,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:22,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721242484f6fc274f0c80d35df815ee2299 2023-07-21 05:11:22,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307219355ac47449449d9b12606908d9769de 2023-07-21 05:11:22,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:22,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:23,019 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:23,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:23,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:23,021 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:11:23,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:23,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-21 05:11:23,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:23,057 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:23,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689916282715Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689916282978 (+263 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689916282978Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689916282978Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689916282992 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689916283016 (+24 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689916283057 (+41 ms) 2023-07-21 05:11:23,061 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-21 05:11:23,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 345 msec 2023-07-21 05:11:23,322 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:23,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-21 05:11:23,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:23,355 DEBUG [Listener at jenkins-hbase4.apache.org/42887] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:11:23,360 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:11:23,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34259] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 05:11:23,362 DEBUG [Listener at jenkins-hbase4.apache.org/42887] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:11:23,365 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:11:23,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41899] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 05:11:23,366 DEBUG [Listener at jenkins-hbase4.apache.org/42887] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-21 05:11:23,373 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-21 05:11:23,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42011] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-21 05:11:23,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-21 05:11:23,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:23,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:11:23,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-21 05:11:23,383 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:11:23,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 05:11:23,387 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:23,387 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:23,388 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5 empty. 2023-07-21 05:11:23,388 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c empty. 2023-07-21 05:11:23,388 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:23,388 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:23,388 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 05:11:23,437 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-21 05:11:23,439 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => abca38e2b209fbda7763b7aea61ab38c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:11:23,441 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 20025e04ea10d4b4d35bbe5229eb3ce5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:11:23,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:23,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing abca38e2b209fbda7763b7aea61ab38c, disabling compactions & flushes 2023-07-21 05:11:23,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:23,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:23,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. after waiting 0 ms 2023-07-21 05:11:23,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:23,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:23,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for abca38e2b209fbda7763b7aea61ab38c: 2023-07-21 05:11:23,455 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:23,455 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 20025e04ea10d4b4d35bbe5229eb3ce5, disabling compactions & flushes 2023-07-21 05:11:23,455 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:23,455 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:23,455 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. after waiting 0 ms 2023-07-21 05:11:23,455 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:23,455 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:23,456 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 20025e04ea10d4b4d35bbe5229eb3ce5: 2023-07-21 05:11:23,458 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:11:23,460 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916283459"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916283459"}]},"ts":"1689916283459"} 2023-07-21 05:11:23,460 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916283459"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916283459"}]},"ts":"1689916283459"} 2023-07-21 05:11:23,462 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:11:23,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:11:23,463 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916283463"}]},"ts":"1689916283463"} 2023-07-21 05:11:23,465 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-21 05:11:23,468 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:11:23,469 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:11:23,470 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:11:23,470 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:11:23,470 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:11:23,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abca38e2b209fbda7763b7aea61ab38c, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20025e04ea10d4b4d35bbe5229eb3ce5, ASSIGN}] 2023-07-21 05:11:23,474 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20025e04ea10d4b4d35bbe5229eb3ce5, ASSIGN 2023-07-21 05:11:23,474 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abca38e2b209fbda7763b7aea61ab38c, ASSIGN 2023-07-21 05:11:23,476 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20025e04ea10d4b4d35bbe5229eb3ce5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42011,1689916199401; forceNewPlan=false, retain=false 2023-07-21 05:11:23,476 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abca38e2b209fbda7763b7aea61ab38c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41899,1689916199499; forceNewPlan=false, retain=false 2023-07-21 05:11:23,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 05:11:23,626 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:11:23,629 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=20025e04ea10d4b4d35bbe5229eb3ce5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:23,629 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=abca38e2b209fbda7763b7aea61ab38c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:23,629 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916283629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916283629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916283629"}]},"ts":"1689916283629"} 2023-07-21 05:11:23,629 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916283629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916283629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916283629"}]},"ts":"1689916283629"} 2023-07-21 05:11:23,631 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure abca38e2b209fbda7763b7aea61ab38c, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:11:23,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 20025e04ea10d4b4d35bbe5229eb3ce5, server=jenkins-hbase4.apache.org,42011,1689916199401}] 2023-07-21 05:11:23,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 05:11:23,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:23,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => abca38e2b209fbda7763b7aea61ab38c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.', STARTKEY => '', ENDKEY => '2'} 2023-07-21 05:11:23,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. service=AccessControlService 2023-07-21 05:11:23,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:23,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:23,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:23,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:23,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:23,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:23,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20025e04ea10d4b4d35bbe5229eb3ce5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.', STARTKEY => '2', ENDKEY => ''} 2023-07-21 05:11:23,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. service=AccessControlService 2023-07-21 05:11:23,791 INFO [StoreOpener-abca38e2b209fbda7763b7aea61ab38c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:23,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:23,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:23,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:23,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:23,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:23,793 DEBUG [StoreOpener-abca38e2b209fbda7763b7aea61ab38c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/cf 2023-07-21 05:11:23,793 DEBUG [StoreOpener-abca38e2b209fbda7763b7aea61ab38c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/cf 2023-07-21 05:11:23,793 INFO [StoreOpener-20025e04ea10d4b4d35bbe5229eb3ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:23,793 INFO [StoreOpener-abca38e2b209fbda7763b7aea61ab38c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abca38e2b209fbda7763b7aea61ab38c columnFamilyName cf 2023-07-21 05:11:23,794 INFO [StoreOpener-abca38e2b209fbda7763b7aea61ab38c-1] regionserver.HStore(310): Store=abca38e2b209fbda7763b7aea61ab38c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:23,794 DEBUG [StoreOpener-20025e04ea10d4b4d35bbe5229eb3ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/cf 2023-07-21 05:11:23,794 DEBUG [StoreOpener-20025e04ea10d4b4d35bbe5229eb3ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/cf 2023-07-21 05:11:23,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:23,795 INFO [StoreOpener-20025e04ea10d4b4d35bbe5229eb3ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20025e04ea10d4b4d35bbe5229eb3ce5 columnFamilyName cf 2023-07-21 05:11:23,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:23,795 INFO [StoreOpener-20025e04ea10d4b4d35bbe5229eb3ce5-1] regionserver.HStore(310): Store=20025e04ea10d4b4d35bbe5229eb3ce5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:23,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:23,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:23,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:23,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:23,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:23,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:23,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened abca38e2b209fbda7763b7aea61ab38c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71407538, jitterRate=0.06405523419380188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:23,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for abca38e2b209fbda7763b7aea61ab38c: 2023-07-21 05:11:23,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 20025e04ea10d4b4d35bbe5229eb3ce5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65192415, jitterRate=-0.028557315468788147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:23,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 20025e04ea10d4b4d35bbe5229eb3ce5: 2023-07-21 05:11:23,810 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c., pid=69, masterSystemTime=1689916283785 2023-07-21 05:11:23,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5., pid=70, masterSystemTime=1689916283788 2023-07-21 05:11:23,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:23,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:23,816 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=abca38e2b209fbda7763b7aea61ab38c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:23,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:23,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:23,816 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916283816"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916283816"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916283816"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916283816"}]},"ts":"1689916283816"} 2023-07-21 05:11:23,817 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=20025e04ea10d4b4d35bbe5229eb3ce5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:23,817 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916283816"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916283816"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916283816"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916283816"}]},"ts":"1689916283816"} 2023-07-21 05:11:23,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-21 05:11:23,821 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure abca38e2b209fbda7763b7aea61ab38c, server=jenkins-hbase4.apache.org,41899,1689916199499 in 187 msec 2023-07-21 05:11:23,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-21 05:11:23,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abca38e2b209fbda7763b7aea61ab38c, ASSIGN in 351 msec 2023-07-21 05:11:23,822 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 20025e04ea10d4b4d35bbe5229eb3ce5, server=jenkins-hbase4.apache.org,42011,1689916199401 in 185 msec 2023-07-21 05:11:23,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-21 05:11:23,824 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20025e04ea10d4b4d35bbe5229eb3ce5, ASSIGN in 352 msec 2023-07-21 05:11:23,825 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:11:23,825 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916283825"}]},"ts":"1689916283825"} 2023-07-21 05:11:23,826 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-21 05:11:23,829 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:11:23,829 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-21 05:11:23,831 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 05:11:23,834 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,834 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,834 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,834 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:23,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,836 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:23,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 463 msec 2023-07-21 05:11:23,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-21 05:11:23,988 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-21 05:11:24,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions abca38e2b209fbda7763b7aea61ab38c, 20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:24,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[abca38e2b209fbda7763b7aea61ab38c, 20025e04ea10d4b4d35bbe5229eb3ce5], force=true 2023-07-21 05:11:24,053 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[abca38e2b209fbda7763b7aea61ab38c, 20025e04ea10d4b4d35bbe5229eb3ce5], force=true 2023-07-21 05:11:24,053 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[abca38e2b209fbda7763b7aea61ab38c, 20025e04ea10d4b4d35bbe5229eb3ce5], force=true 2023-07-21 05:11:24,053 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[abca38e2b209fbda7763b7aea61ab38c, 20025e04ea10d4b4d35bbe5229eb3ce5], force=true 2023-07-21 05:11:24,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:24,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abca38e2b209fbda7763b7aea61ab38c, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20025e04ea10d4b4d35bbe5229eb3ce5, UNASSIGN}] 2023-07-21 05:11:24,098 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abca38e2b209fbda7763b7aea61ab38c, UNASSIGN 2023-07-21 05:11:24,099 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20025e04ea10d4b4d35bbe5229eb3ce5, UNASSIGN 2023-07-21 05:11:24,100 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=abca38e2b209fbda7763b7aea61ab38c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:24,100 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=20025e04ea10d4b4d35bbe5229eb3ce5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:24,100 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916284100"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916284100"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916284100"}]},"ts":"1689916284100"} 2023-07-21 05:11:24,100 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916284100"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916284100"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916284100"}]},"ts":"1689916284100"} 2023-07-21 05:11:24,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure abca38e2b209fbda7763b7aea61ab38c, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:11:24,103 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 20025e04ea10d4b4d35bbe5229eb3ce5, server=jenkins-hbase4.apache.org,42011,1689916199401}] 2023-07-21 05:11:24,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:24,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:24,260 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:24,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing abca38e2b209fbda7763b7aea61ab38c, disabling compactions & flushes 2023-07-21 05:11:24,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:24,261 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:24,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. after waiting 1 ms 2023-07-21 05:11:24,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:24,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing abca38e2b209fbda7763b7aea61ab38c 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 05:11:24,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 20025e04ea10d4b4d35bbe5229eb3ce5, disabling compactions & flushes 2023-07-21 05:11:24,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:24,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:24,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. after waiting 0 ms 2023-07-21 05:11:24,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:24,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 20025e04ea10d4b4d35bbe5229eb3ce5 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-21 05:11:24,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/.tmp/cf/4f65c1e58f2c42939ec583ac5f8e8df8 2023-07-21 05:11:24,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/.tmp/cf/4f65c1e58f2c42939ec583ac5f8e8df8 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/cf/4f65c1e58f2c42939ec583ac5f8e8df8 2023-07-21 05:11:24,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/.tmp/cf/da730d9efa90490ab28f9a0865ca382f 2023-07-21 05:11:24,338 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/.tmp/cf/da730d9efa90490ab28f9a0865ca382f as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/cf/da730d9efa90490ab28f9a0865ca382f 2023-07-21 05:11:24,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/cf/da730d9efa90490ab28f9a0865ca382f, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 05:11:24,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/cf/4f65c1e58f2c42939ec583ac5f8e8df8, entries=1, sequenceid=5, filesize=4.7 K 2023-07-21 05:11:24,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for abca38e2b209fbda7763b7aea61ab38c in 87ms, sequenceid=5, compaction requested=false 2023-07-21 05:11:24,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 05:11:24,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 20025e04ea10d4b4d35bbe5229eb3ce5 in 88ms, sequenceid=5, compaction requested=false 2023-07-21 05:11:24,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 05:11:24,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:24,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 05:11:24,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-21 05:11:24,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:24,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c. 2023-07-21 05:11:24,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for abca38e2b209fbda7763b7aea61ab38c: 2023-07-21 05:11:24,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:24,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5. 2023-07-21 05:11:24,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 20025e04ea10d4b4d35bbe5229eb3ce5: 2023-07-21 05:11:24,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:24,394 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=abca38e2b209fbda7763b7aea61ab38c, regionState=CLOSED 2023-07-21 05:11:24,394 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916284393"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916284393"}]},"ts":"1689916284393"} 2023-07-21 05:11:24,394 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:24,395 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=20025e04ea10d4b4d35bbe5229eb3ce5, regionState=CLOSED 2023-07-21 05:11:24,395 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689916284395"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916284395"}]},"ts":"1689916284395"} 2023-07-21 05:11:24,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-21 05:11:24,401 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure abca38e2b209fbda7763b7aea61ab38c, server=jenkins-hbase4.apache.org,41899,1689916199499 in 295 msec 2023-07-21 05:11:24,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-21 05:11:24,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 20025e04ea10d4b4d35bbe5229eb3ce5, server=jenkins-hbase4.apache.org,42011,1689916199401 in 294 msec 2023-07-21 05:11:24,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abca38e2b209fbda7763b7aea61ab38c, UNASSIGN in 315 msec 2023-07-21 05:11:24,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-21 05:11:24,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=20025e04ea10d4b4d35bbe5229eb3ce5, UNASSIGN in 308 msec 2023-07-21 05:11:24,543 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-21 05:11:24,547 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283376.abca38e2b209fbda7763b7aea61ab38c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:24,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689916283376.20025e04ea10d4b4d35bbe5229eb3ce5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:24,548 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:24,623 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59f170fa141ff4de2bcf740c3b644387, ASSIGN}] 2023-07-21 05:11:24,625 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59f170fa141ff4de2bcf740c3b644387, ASSIGN 2023-07-21 05:11:24,626 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59f170fa141ff4de2bcf740c3b644387, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,41899,1689916199499; forceNewPlan=false, retain=false 2023-07-21 05:11:24,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:24,776 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-21 05:11:24,778 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=59f170fa141ff4de2bcf740c3b644387, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:24,778 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689916284778"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916284778"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916284778"}]},"ts":"1689916284778"} 2023-07-21 05:11:24,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 59f170fa141ff4de2bcf740c3b644387, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:11:24,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. 2023-07-21 05:11:24,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 59f170fa141ff4de2bcf740c3b644387, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.', STARTKEY => '', ENDKEY => ''} 2023-07-21 05:11:24,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. service=AccessControlService 2023-07-21 05:11:24,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:24,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:24,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:24,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:24,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:24,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/.regioninfo 2023-07-21 05:11:25,011 INFO [StoreOpener-59f170fa141ff4de2bcf740c3b644387-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:25,012 DEBUG [StoreOpener-59f170fa141ff4de2bcf740c3b644387-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf 2023-07-21 05:11:25,012 DEBUG [StoreOpener-59f170fa141ff4de2bcf740c3b644387-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf 2023-07-21 05:11:25,012 INFO [StoreOpener-59f170fa141ff4de2bcf740c3b644387-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 59f170fa141ff4de2bcf740c3b644387 columnFamilyName cf 2023-07-21 05:11:25,030 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0004_000001 (auth:SIMPLE) 2023-07-21 05:11:25,058 DEBUG [StoreOpener-59f170fa141ff4de2bcf740c3b644387-1] regionserver.HStore(539): loaded hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/4f65c1e58f2c42939ec583ac5f8e8df8.20025e04ea10d4b4d35bbe5229eb3ce5->hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/cf/4f65c1e58f2c42939ec583ac5f8e8df8-top 2023-07-21 05:11:25,068 DEBUG [StoreOpener-59f170fa141ff4de2bcf740c3b644387-1] regionserver.HStore(539): loaded hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/da730d9efa90490ab28f9a0865ca382f.abca38e2b209fbda7763b7aea61ab38c->hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/cf/da730d9efa90490ab28f9a0865ca382f-top 2023-07-21 05:11:25,069 INFO [StoreOpener-59f170fa141ff4de2bcf740c3b644387-1] regionserver.HStore(310): Store=59f170fa141ff4de2bcf740c3b644387/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:25,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:25,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:25,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:25,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 59f170fa141ff4de2bcf740c3b644387; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60056048, jitterRate=-0.10509514808654785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:25,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 59f170fa141ff4de2bcf740c3b644387: 2023-07-21 05:11:25,077 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387., pid=77, masterSystemTime=1689916284932 2023-07-21 05:11:25,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.,because compaction is disabled. 2023-07-21 05:11:25,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. 2023-07-21 05:11:25,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. 2023-07-21 05:11:25,082 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=59f170fa141ff4de2bcf740c3b644387, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,082 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689916285082"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916285082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916285082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916285082"}]},"ts":"1689916285082"} 2023-07-21 05:11:25,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-21 05:11:25,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 59f170fa141ff4de2bcf740c3b644387, server=jenkins-hbase4.apache.org,41899,1689916199499 in 304 msec 2023-07-21 05:11:25,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-21 05:11:25,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59f170fa141ff4de2bcf740c3b644387, ASSIGN in 463 msec 2023-07-21 05:11:25,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[abca38e2b209fbda7763b7aea61ab38c, 20025e04ea10d4b4d35bbe5229eb3ce5], force=true in 1.0430 sec 2023-07-21 05:11:25,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-21 05:11:25,180 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-21 05:11:25,181 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 05:11:25,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916285181 (current time:1689916285181). 2023-07-21 05:11:25,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:25,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x4276a735 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:25,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cb1410b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:25,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:25,204 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:25,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4276a735 to 127.0.0.1:51418 2023-07-21 05:11:25,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:25,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x0d8c4b30 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:25,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ab40abb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:25,215 DEBUG [hconnection-0x3ccba5ff-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:25,218 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:25,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:25,226 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:25,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d8c4b30 to 127.0.0.1:51418 2023-07-21 05:11:25,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:25,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-21 05:11:25,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:25,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 05:11:25,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 05:11:25,231 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 05:11:25,232 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689916885232 2023-07-21 05:11:25,232 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-21 05:11:25,236 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 05:11:25,237 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-21 05:11:25,237 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:25,237 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:25,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-21 05:11:25,240 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 05:11:25,240 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689916885240 2023-07-21 05:11:25,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,273 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-21 05:11:25,273 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:25,274 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-21 05:11:25,274 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-21 05:11:25,275 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,275 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,276 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:25,276 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:25,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:25,276 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:25,276 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:25,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:25,277 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,277 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 05:11:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 05:11:25,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,278 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 05:11:25,278 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:25,280 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 05:11:25,280 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 05:11:25,280 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 05:11:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 05:11:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,281 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 05:11:25,281 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,281 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 05:11:25,281 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:25,282 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 05:11:25,282 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 05:11:25,282 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 05:11:25,282 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-21 05:11:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,283 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-21 05:11:25,283 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,283 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:25,283 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,283 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-21 05:11:25,283 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-21 05:11:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-21 05:11:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-21 05:11:25,286 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,288 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,288 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-21 05:11:25,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38e8f533[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:25,290 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-21 05:11:25,290 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 05:11:25,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,292 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 05:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-21 05:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 05:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 05:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:11:25,292 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. 2023-07-21 05:11:25,292 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:11:25,293 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. started... 2023-07-21 05:11:25,294 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 59f170fa141ff4de2bcf740c3b644387: 2023-07-21 05:11:25,294 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,295 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:25,295 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/4f65c1e58f2c42939ec583ac5f8e8df8.20025e04ea10d4b4d35bbe5229eb3ce5->hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/cf/4f65c1e58f2c42939ec583ac5f8e8df8-top, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/da730d9efa90490ab28f9a0865ca382f.abca38e2b209fbda7763b7aea61ab38c->hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/cf/da730d9efa90490ab28f9a0865ca382f-top] hfiles 2023-07-21 05:11:25,295 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/4f65c1e58f2c42939ec583ac5f8e8df8.20025e04ea10d4b4d35bbe5229eb3ce5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,295 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/da730d9efa90490ab28f9a0865ca382f.abca38e2b209fbda7763b7aea61ab38c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,298 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 05:11:25,298 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 05:11:25,298 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:25,298 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 05:11:25,298 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:25,298 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 05:11:25,325 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. completed. 2023-07-21 05:11:25,325 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. 2023-07-21 05:11:25,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:25,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:25,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-21 05:11:25,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:11:25,331 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,331 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-21 05:11:25,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:25,331 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:25,332 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-21 05:11:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:25,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:25,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:25,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,41899,1689916199499': 2023-07-21 05:11:25,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-21 05:11:25,336 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-21 05:11:25,336 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:25,336 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:25,336 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,336 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:25,337 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:25,338 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,338 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:25,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 05:11:25,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,339 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,338 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,338 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,339 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:25,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,339 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,339 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:25,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,339 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:25,340 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,342 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:25,345 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:25,345 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:25,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,346 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:25,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:25,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:25,353 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:25,353 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,353 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:25,353 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:25,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:25,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:25,353 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:25,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:25,353 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:25,353 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:25,354 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:25,354 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,354 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:25,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:25,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,354 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:25,354 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,355 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,355 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:25,355 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,355 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:25,355 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:25,355 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,355 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:25,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:25,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-21 05:11:25,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,463 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689916285232Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689916285354 (+122 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689916285354Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689916285363 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689916285395 (+32 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689916285462 (+67 ms) 2023-07-21 05:11:25,465 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-21 05:11:25,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 231 msec 2023-07-21 05:11:25,540 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:25,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-21 05:11:25,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:25,541 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541 2023-07-21 05:11:25,541 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40289, tgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541, rawTgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541, srcFsUri=hdfs://localhost:40289, srcDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:11:25,567 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:11:25,567 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1521020672_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,567 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13, snapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-21 05:11:25,576 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:25,600 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:25,601 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:25,601 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:25,602 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:25,924 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:11:26,680 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-1142772418083312915.jar 2023-07-21 05:11:26,681 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:26,681 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:26,749 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-5673699678283623653.jar 2023-07-21 05:11:26,749 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:26,750 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:26,750 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:26,750 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:26,751 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:26,751 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:26,752 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:11:26,752 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:11:26,752 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:11:26,753 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:11:26,753 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:11:26,753 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:11:26,754 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:11:26,754 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:11:26,754 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:11:26,755 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:11:26,756 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:26,756 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:26,757 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:26,757 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:26,757 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:26,758 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:26,758 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:27,736 WARN [Listener at jenkins-hbase4.apache.org/42887] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:11:27,740 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-21 05:11:27,742 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-21 05:11:27,800 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:27,801 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:28,028 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0005_000001 (auth:SIMPLE) 2023-07-21 05:11:34,164 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0005_000001 (auth:SIMPLE) 2023-07-21 05:11:36,476 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0005_000001 (auth:SIMPLE) 2023-07-21 05:11:41,981 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:11:42,001 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:11:42,058 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,058 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:11:42,059 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:11:42,059 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,060 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 05:11:42,060 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 05:11:42,060 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,061 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-21 05:11:42,061 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916285541/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-21 05:11:42,070 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,070 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 05:11:42,077 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916302077"}]},"ts":"1689916302077"} 2023-07-21 05:11:42,078 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-21 05:11:42,131 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-21 05:11:42,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59f170fa141ff4de2bcf740c3b644387, UNASSIGN}] 2023-07-21 05:11:42,136 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59f170fa141ff4de2bcf740c3b644387, UNASSIGN 2023-07-21 05:11:42,138 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=59f170fa141ff4de2bcf740c3b644387, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:42,138 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689916302138"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916302138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916302138"}]},"ts":"1689916302138"} 2023-07-21 05:11:42,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 59f170fa141ff4de2bcf740c3b644387, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:11:42,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 05:11:42,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:42,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 59f170fa141ff4de2bcf740c3b644387, disabling compactions & flushes 2023-07-21 05:11:42,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. 2023-07-21 05:11:42,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. 2023-07-21 05:11:42,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. after waiting 0 ms 2023-07-21 05:11:42,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. 2023-07-21 05:11:42,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-21 05:11:42,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:42,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387. 2023-07-21 05:11:42,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 59f170fa141ff4de2bcf740c3b644387: 2023-07-21 05:11:42,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:42,359 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=59f170fa141ff4de2bcf740c3b644387, regionState=CLOSED 2023-07-21 05:11:42,360 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689916302359"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916302359"}]},"ts":"1689916302359"} 2023-07-21 05:11:42,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-21 05:11:42,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 59f170fa141ff4de2bcf740c3b644387, server=jenkins-hbase4.apache.org,41899,1689916199499 in 232 msec 2023-07-21 05:11:42,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-21 05:11:42,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=59f170fa141ff4de2bcf740c3b644387, UNASSIGN in 241 msec 2023-07-21 05:11:42,377 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916302377"}]},"ts":"1689916302377"} 2023-07-21 05:11:42,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 05:11:42,381 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-21 05:11:42,386 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-21 05:11:42,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 320 msec 2023-07-21 05:11:42,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-21 05:11:42,681 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-21 05:11:42,682 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,687 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,688 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,690 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,693 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,693 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 05:11:42,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 05:11:42,694 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,694 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,695 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:42,695 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:42,695 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:42,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 05:11:42,695 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-21 05:11:42,697 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,698 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,698 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:42,698 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:42,698 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,698 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:42,698 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,698 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:42,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 05:11:42,699 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:42,699 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/recovered.edits] 2023-07-21 05:11:42,699 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:42,699 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/recovered.edits] 2023-07-21 05:11:42,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:42,700 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/recovered.edits] 2023-07-21 05:11:42,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:42,707 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/cf/da730d9efa90490ab28f9a0865ca382f to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/cf/da730d9efa90490ab28f9a0865ca382f 2023-07-21 05:11:42,708 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/4f65c1e58f2c42939ec583ac5f8e8df8.20025e04ea10d4b4d35bbe5229eb3ce5 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/4f65c1e58f2c42939ec583ac5f8e8df8.20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:42,708 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/cf/4f65c1e58f2c42939ec583ac5f8e8df8 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/cf/4f65c1e58f2c42939ec583ac5f8e8df8 2023-07-21 05:11:42,710 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/da730d9efa90490ab28f9a0865ca382f.abca38e2b209fbda7763b7aea61ab38c to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/cf/da730d9efa90490ab28f9a0865ca382f.abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:42,719 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/recovered.edits/8.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5/recovered.edits/8.seqid 2023-07-21 05:11:42,720 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/20025e04ea10d4b4d35bbe5229eb3ce5 2023-07-21 05:11:42,721 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/recovered.edits/12.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387/recovered.edits/12.seqid 2023-07-21 05:11:42,722 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/59f170fa141ff4de2bcf740c3b644387 2023-07-21 05:11:42,727 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/recovered.edits/8.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c/recovered.edits/8.seqid 2023-07-21 05:11:42,728 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abca38e2b209fbda7763b7aea61ab38c 2023-07-21 05:11:42,728 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-21 05:11:42,731 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,741 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-21 05:11:42,743 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-21 05:11:42,745 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,745 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-21 05:11:42,745 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916302745"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:42,748 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-21 05:11:42,748 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 59f170fa141ff4de2bcf740c3b644387, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689916283377.59f170fa141ff4de2bcf740c3b644387.', STARTKEY => '', ENDKEY => ''}] 2023-07-21 05:11:42,748 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-21 05:11:42,748 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916302748"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:42,750 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-21 05:11:42,752 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:42,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 70 msec 2023-07-21 05:11:42,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-21 05:11:42,800 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-21 05:11:42,801 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:42,801 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:42,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:42,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 05:11:42,809 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916302809"}]},"ts":"1689916302809"} 2023-07-21 05:11:42,812 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-21 05:11:42,814 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-21 05:11:42,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ea5e82e0f86611c32c29842e652c181a, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fbfa0d06f4e5018a9858f207a7a1139, UNASSIGN}] 2023-07-21 05:11:42,818 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ea5e82e0f86611c32c29842e652c181a, UNASSIGN 2023-07-21 05:11:42,818 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fbfa0d06f4e5018a9858f207a7a1139, UNASSIGN 2023-07-21 05:11:42,820 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ea5e82e0f86611c32c29842e652c181a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:42,820 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2fbfa0d06f4e5018a9858f207a7a1139, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:42,820 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916302820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916302820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916302820"}]},"ts":"1689916302820"} 2023-07-21 05:11:42,820 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916302820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916302820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916302820"}]},"ts":"1689916302820"} 2023-07-21 05:11:42,823 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure ea5e82e0f86611c32c29842e652c181a, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:11:42,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 2fbfa0d06f4e5018a9858f207a7a1139, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:11:42,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 05:11:42,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:42,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea5e82e0f86611c32c29842e652c181a, disabling compactions & flushes 2023-07-21 05:11:42,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:42,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:42,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. after waiting 0 ms 2023-07-21 05:11:42,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:42,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:42,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2fbfa0d06f4e5018a9858f207a7a1139, disabling compactions & flushes 2023-07-21 05:11:42,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:42,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:42,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. after waiting 0 ms 2023-07-21 05:11:42,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:43,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:43,042 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:43,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:43,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139. 2023-07-21 05:11:43,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2fbfa0d06f4e5018a9858f207a7a1139: 2023-07-21 05:11:43,045 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:43,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a. 2023-07-21 05:11:43,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea5e82e0f86611c32c29842e652c181a: 2023-07-21 05:11:43,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:43,051 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2fbfa0d06f4e5018a9858f207a7a1139, regionState=CLOSED 2023-07-21 05:11:43,051 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916303051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916303051"}]},"ts":"1689916303051"} 2023-07-21 05:11:43,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ea5e82e0f86611c32c29842e652c181a, regionState=CLOSED 2023-07-21 05:11:43,052 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689916303052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916303052"}]},"ts":"1689916303052"} 2023-07-21 05:11:43,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:43,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-21 05:11:43,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 2fbfa0d06f4e5018a9858f207a7a1139, server=jenkins-hbase4.apache.org,41899,1689916199499 in 229 msec 2023-07-21 05:11:43,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-21 05:11:43,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure ea5e82e0f86611c32c29842e652c181a, server=jenkins-hbase4.apache.org,34259,1689916199459 in 231 msec 2023-07-21 05:11:43,065 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fbfa0d06f4e5018a9858f207a7a1139, UNASSIGN in 244 msec 2023-07-21 05:11:43,070 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-21 05:11:43,070 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ea5e82e0f86611c32c29842e652c181a, UNASSIGN in 249 msec 2023-07-21 05:11:43,071 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916303071"}]},"ts":"1689916303071"} 2023-07-21 05:11:43,073 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-21 05:11:43,075 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-21 05:11:43,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 277 msec 2023-07-21 05:11:43,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-21 05:11:43,112 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-21 05:11:43,113 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,117 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,119 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,120 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,123 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,123 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,123 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,123 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 05:11:43,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 05:11:43,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 05:11:43,125 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-21 05:11:43,125 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,125 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,125 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:43,125 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:43,125 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:43,125 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:43,126 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,126 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:43,125 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,126 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:43,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 05:11:43,128 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/recovered.edits] 2023-07-21 05:11:43,129 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/recovered.edits] 2023-07-21 05:11:43,137 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/cf/a5c9971960514f88963f503506ed7aba to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/cf/a5c9971960514f88963f503506ed7aba 2023-07-21 05:11:43,137 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/cf/9a480e438db84d5e81693959bd2038fd to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/cf/9a480e438db84d5e81693959bd2038fd 2023-07-21 05:11:43,142 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139/recovered.edits/9.seqid 2023-07-21 05:11:43,143 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fbfa0d06f4e5018a9858f207a7a1139 2023-07-21 05:11:43,143 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a/recovered.edits/9.seqid 2023-07-21 05:11:43,144 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ea5e82e0f86611c32c29842e652c181a 2023-07-21 05:11:43,144 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-21 05:11:43,146 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-21 05:11:43,147 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-21 05:11:43,152 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721242484f6fc274f0c80d35df815ee2299 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230721242484f6fc274f0c80d35df815ee2299 2023-07-21 05:11:43,154 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307219355ac47449449d9b12606908d9769de to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307219355ac47449449d9b12606908d9769de 2023-07-21 05:11:43,155 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-21 05:11:43,162 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,167 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-21 05:11:43,178 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-21 05:11:43,180 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,180 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-21 05:11:43,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916303180"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:43,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916303180"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:43,182 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:11:43,182 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ea5e82e0f86611c32c29842e652c181a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689916280836.ea5e82e0f86611c32c29842e652c181a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2fbfa0d06f4e5018a9858f207a7a1139, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689916280836.2fbfa0d06f4e5018a9858f207a7a1139.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:11:43,182 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-21 05:11:43,182 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916303182"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:43,184 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-21 05:11:43,188 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 75 msec 2023-07-21 05:11:43,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-21 05:11:43,229 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-21 05:11:43,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 05:11:43,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-21 05:11:43,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-21 05:11:43,257 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-21 05:11:43,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-21 05:11:43,298 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=755 (was 743) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1915921609) connection to jenkins-hbase4.apache.org/172.31.14.131:34733 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:57692 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4104 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_850521012_1 at /127.0.0.1:48664 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:56422 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:39402 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 891) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=737 (was 476) - SystemLoadAverage LEAK? -, ProcessCount=189 (was 188) - ProcessCount LEAK? -, AvailableMemoryMB=1258 (was 1782) 2023-07-21 05:11:43,298 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-21 05:11:43,333 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=755, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=737, ProcessCount=188, AvailableMemoryMB=1253 2023-07-21 05:11:43,333 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-21 05:11:43,335 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 05:11:43,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:11:43,340 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:11:43,341 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-21 05:11:43,342 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:11:43,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 05:11:43,345 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:43,345 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:43,346 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4 empty. 2023-07-21 05:11:43,346 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67 empty. 2023-07-21 05:11:43,346 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:43,347 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:43,347 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 05:11:43,391 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-21 05:11:43,398 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 90f3bc1dc109e3c4d5f455bcefcb10d4, NAME => 'testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:11:43,403 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 23f3df84c81de3a03a1fc714eb53ff67, NAME => 'testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:11:43,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 05:11:43,515 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:43,515 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 90f3bc1dc109e3c4d5f455bcefcb10d4, disabling compactions & flushes 2023-07-21 05:11:43,515 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:43,515 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:43,515 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. after waiting 0 ms 2023-07-21 05:11:43,515 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:43,515 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:43,515 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 90f3bc1dc109e3c4d5f455bcefcb10d4: 2023-07-21 05:11:43,522 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:43,522 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 23f3df84c81de3a03a1fc714eb53ff67, disabling compactions & flushes 2023-07-21 05:11:43,522 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:43,522 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:43,522 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. after waiting 0 ms 2023-07-21 05:11:43,522 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:43,522 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:43,522 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 23f3df84c81de3a03a1fc714eb53ff67: 2023-07-21 05:11:43,533 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:11:43,534 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916303533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916303533"}]},"ts":"1689916303533"} 2023-07-21 05:11:43,534 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916303533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916303533"}]},"ts":"1689916303533"} 2023-07-21 05:11:43,543 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:11:43,544 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:11:43,544 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916303544"}]},"ts":"1689916303544"} 2023-07-21 05:11:43,546 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-21 05:11:43,551 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:11:43,553 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:11:43,553 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:11:43,553 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:11:43,553 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:11:43,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=90f3bc1dc109e3c4d5f455bcefcb10d4, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=23f3df84c81de3a03a1fc714eb53ff67, ASSIGN}] 2023-07-21 05:11:43,556 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=23f3df84c81de3a03a1fc714eb53ff67, ASSIGN 2023-07-21 05:11:43,556 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=90f3bc1dc109e3c4d5f455bcefcb10d4, ASSIGN 2023-07-21 05:11:43,558 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=23f3df84c81de3a03a1fc714eb53ff67, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41899,1689916199499; forceNewPlan=false, retain=false 2023-07-21 05:11:43,558 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=90f3bc1dc109e3c4d5f455bcefcb10d4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34259,1689916199459; forceNewPlan=false, retain=false 2023-07-21 05:11:43,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 05:11:43,708 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:11:43,711 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=90f3bc1dc109e3c4d5f455bcefcb10d4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:43,711 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=23f3df84c81de3a03a1fc714eb53ff67, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:43,711 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916303711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916303711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916303711"}]},"ts":"1689916303711"} 2023-07-21 05:11:43,711 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916303711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916303711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916303711"}]},"ts":"1689916303711"} 2023-07-21 05:11:43,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 90f3bc1dc109e3c4d5f455bcefcb10d4, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:11:43,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 23f3df84c81de3a03a1fc714eb53ff67, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:11:43,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:43,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 90f3bc1dc109e3c4d5f455bcefcb10d4, NAME => 'testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:11:43,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. service=AccessControlService 2023-07-21 05:11:43,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:43,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:43,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:43,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:43,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 23f3df84c81de3a03a1fc714eb53ff67, NAME => 'testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:11:43,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:43,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:43,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. service=AccessControlService 2023-07-21 05:11:43,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:43,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:43,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:43,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:43,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:43,877 INFO [StoreOpener-90f3bc1dc109e3c4d5f455bcefcb10d4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:43,877 INFO [StoreOpener-23f3df84c81de3a03a1fc714eb53ff67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:43,878 DEBUG [StoreOpener-90f3bc1dc109e3c4d5f455bcefcb10d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/cf 2023-07-21 05:11:43,878 DEBUG [StoreOpener-90f3bc1dc109e3c4d5f455bcefcb10d4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/cf 2023-07-21 05:11:43,878 INFO [StoreOpener-90f3bc1dc109e3c4d5f455bcefcb10d4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90f3bc1dc109e3c4d5f455bcefcb10d4 columnFamilyName cf 2023-07-21 05:11:43,879 DEBUG [StoreOpener-23f3df84c81de3a03a1fc714eb53ff67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/cf 2023-07-21 05:11:43,879 DEBUG [StoreOpener-23f3df84c81de3a03a1fc714eb53ff67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/cf 2023-07-21 05:11:43,879 INFO [StoreOpener-23f3df84c81de3a03a1fc714eb53ff67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23f3df84c81de3a03a1fc714eb53ff67 columnFamilyName cf 2023-07-21 05:11:43,880 INFO [StoreOpener-23f3df84c81de3a03a1fc714eb53ff67-1] regionserver.HStore(310): Store=23f3df84c81de3a03a1fc714eb53ff67/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:43,880 INFO [StoreOpener-90f3bc1dc109e3c4d5f455bcefcb10d4-1] regionserver.HStore(310): Store=90f3bc1dc109e3c4d5f455bcefcb10d4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:43,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:43,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:43,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:43,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:43,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:43,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:43,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:43,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:43,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 23f3df84c81de3a03a1fc714eb53ff67; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73685152, jitterRate=0.09799432754516602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:43,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 23f3df84c81de3a03a1fc714eb53ff67: 2023-07-21 05:11:43,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 90f3bc1dc109e3c4d5f455bcefcb10d4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61120639, jitterRate=-0.08923150599002838}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:43,887 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67., pid=94, masterSystemTime=1689916303872 2023-07-21 05:11:43,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 90f3bc1dc109e3c4d5f455bcefcb10d4: 2023-07-21 05:11:43,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4., pid=93, masterSystemTime=1689916303871 2023-07-21 05:11:43,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:43,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:43,890 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=23f3df84c81de3a03a1fc714eb53ff67, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:43,891 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916303890"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916303890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916303890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916303890"}]},"ts":"1689916303890"} 2023-07-21 05:11:43,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:43,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:43,894 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=90f3bc1dc109e3c4d5f455bcefcb10d4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:43,894 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916303894"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916303894"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916303894"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916303894"}]},"ts":"1689916303894"} 2023-07-21 05:11:43,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-21 05:11:43,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 23f3df84c81de3a03a1fc714eb53ff67, server=jenkins-hbase4.apache.org,41899,1689916199499 in 179 msec 2023-07-21 05:11:43,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-21 05:11:43,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=23f3df84c81de3a03a1fc714eb53ff67, ASSIGN in 345 msec 2023-07-21 05:11:43,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 90f3bc1dc109e3c4d5f455bcefcb10d4, server=jenkins-hbase4.apache.org,34259,1689916199459 in 183 msec 2023-07-21 05:11:43,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-21 05:11:43,901 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=90f3bc1dc109e3c4d5f455bcefcb10d4, ASSIGN in 346 msec 2023-07-21 05:11:43,901 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:11:43,901 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916303901"}]},"ts":"1689916303901"} 2023-07-21 05:11:43,902 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-21 05:11:43,905 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:11:43,905 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-21 05:11:43,907 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:11:43,908 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:43,908 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:43,908 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:43,908 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:43,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:43,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:43,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:43,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:43,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 576 msec 2023-07-21 05:11:43,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-21 05:11:43,948 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-21 05:11:43,951 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:43,951 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:43,953 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:43,967 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:43,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916303967 (current time:1689916303967). 2023-07-21 05:11:43,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:43,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x4eb36165 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:43,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66f074cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:43,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:43,996 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:43,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4eb36165 to 127.0.0.1:51418 2023-07-21 05:11:43,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:43,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x669fb458 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:44,025 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-21 05:11:44,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33f249a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:44,055 DEBUG [hconnection-0x56c1051a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:44,056 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:44,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:44,064 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39440, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:44,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x669fb458 to 127.0.0.1:51418 2023-07-21 05:11:44,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:44,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:11:44,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:44,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:44,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:44,074 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:44,075 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689916904075 2023-07-21 05:11:44,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:44,075 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:44,077 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:44,077 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:44,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:44,080 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:44,081 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-21 05:11:44,086 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:44,087 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689916904087 2023-07-21 05:11:44,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,164 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-21 05:11:44,164 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:44,167 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 05:11:44,167 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 05:11:44,168 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,168 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,175 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:44,176 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:44,176 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:44,176 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:44,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:44,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:44,177 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:44,177 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,178 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:44,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 05:11:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 05:11:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:44,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:44,180 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:44,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:44,179 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,180 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:44,180 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:44,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:44,185 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:44,186 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:44,186 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:44,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,191 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:44,191 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:44,191 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-21 05:11:44,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,206 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:44,206 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:44,206 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:44,206 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:44,207 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:44,208 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:44,211 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,211 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:44,211 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,212 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,212 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:44,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:44,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 05:11:44,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c015047[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:44,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,228 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:44,232 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:44,237 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:44,237 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:44,238 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:44,240 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,240 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:44,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:44,241 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:44,241 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:44,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:44,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:44,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 05:11:44,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c015047[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:44,244 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 05:11:44,244 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,246 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,246 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,246 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,246 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:44,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:11:44,247 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:44,247 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. started... 2023-07-21 05:11:44,247 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:44,247 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:44,250 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,250 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:44,250 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 23f3df84c81de3a03a1fc714eb53ff67: 2023-07-21 05:11:44,251 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:44,251 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:44,251 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:44,253 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,253 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:44,253 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:44,254 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:44,254 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. started... 2023-07-21 05:11:44,254 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 90f3bc1dc109e3c4d5f455bcefcb10d4: 2023-07-21 05:11:44,254 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,254 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:44,254 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:44,313 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. completed. 2023-07-21 05:11:44,313 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:44,313 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:44,314 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:44,314 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,314 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:44,314 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:11:44,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,316 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:44,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:44,316 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:44,317 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:44,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:44,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:44,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:44,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,325 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. completed. 2023-07-21 05:11:44,325 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:44,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:44,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:44,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:44,325 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:11:44,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,327 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:44,327 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:44,327 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:44,329 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:11:44,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 05:11:44,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:44,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:44,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:44,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:44,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:44,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41899,1689916199499': 2023-07-21 05:11:44,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 05:11:44,346 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 05:11:44,346 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:44,346 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:44,346 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,346 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:44,348 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,348 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,348 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:44,348 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:44,348 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,349 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:44,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,349 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:44,349 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:44,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:44,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,350 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:44,352 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:44,355 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,356 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,356 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:44,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:44,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,365 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:44,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:44,365 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,366 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:44,366 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,366 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:11:44,367 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:44,367 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:44,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:44,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:44,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:44,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:44,370 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:44,370 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:44,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:44,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:44,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 05:11:44,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:44,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:44,391 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:44,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:44,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:44,394 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:11:44,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 05:11:44,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,507 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689916304075Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689916304422 (+347 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689916304422Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689916304422Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689916304449 (+27 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689916304471 (+22 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689916304506 (+35 ms) 2023-07-21 05:11:44,511 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:44,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 435 msec 2023-07-21 05:11:44,694 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:44,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:44,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:44,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34259] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:44,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41899] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:44,707 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:44,707 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:44,707 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:44,720 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:44,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916304720 (current time:1689916304720). 2023-07-21 05:11:44,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:44,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x0fef5420 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:44,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51d87912, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:44,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:44,771 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:44,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fef5420 to 127.0.0.1:51418 2023-07-21 05:11:44,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:44,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x78ab4d10 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:44,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d104871, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:44,819 DEBUG [hconnection-0x1f92b028-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:44,824 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:44,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:44,831 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:44,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78ab4d10 to 127.0.0.1:51418 2023-07-21 05:11:44,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:44,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-21 05:11:44,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:44,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:44,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:44,840 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:44,842 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689916904842 2023-07-21 05:11:44,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-21 05:11:44,842 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:44,844 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:44,844 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:44,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:44,849 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-21 05:11:44,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-07-21 05:11:44,854 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:44,856 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689916904856 2023-07-21 05:11:44,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,877 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-21 05:11:44,877 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:44,879 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-21 05:11:44,879 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-21 05:11:44,883 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,883 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,885 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:44,886 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:44,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:44,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:44,886 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:44,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:44,886 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,886 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,887 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,887 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,887 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 05:11:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,888 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 05:11:44,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,888 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:44,892 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,892 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,892 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:44,892 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:44,892 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:44,892 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:44,893 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-21 05:11:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,895 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:44,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-21 05:11:44,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,896 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-21 05:11:44,896 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:44,897 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,897 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,901 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-21 05:11:44,901 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-21 05:11:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:44,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:44,901 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-21 05:11:44,902 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,902 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:44,902 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,902 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,904 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,904 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,904 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:44,904 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:44,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:44,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 05:11:44,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a3d1167[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:44,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:44,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-21 05:11:44,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a3d1167[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:44,910 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-21 05:11:44,911 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:44,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:44,917 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:44,917 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-21 05:11:44,918 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:44,918 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:11:44,918 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:44,918 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:44,918 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:44,918 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:44,918 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:44,919 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. started... 2023-07-21 05:11:44,919 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 23f3df84c81de3a03a1fc714eb53ff67 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-21 05:11:44,920 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:44,920 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:44,920 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:44,920 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:44,921 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:44,936 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:44,936 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. started... 2023-07-21 05:11:44,936 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 90f3bc1dc109e3c4d5f455bcefcb10d4 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-21 05:11:44,945 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:44,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:44,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:44,948 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:45,047 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230721d49fd544cb50488b98c2aee7950fcd46 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230721d49fd544cb50488b98c2aee7950fcd46 2023-07-21 05:11:45,047 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307216320a95356ad4f97ad9d9ff327e92fe0 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307216320a95356ad4f97ad9d9ff327e92fe0 2023-07-21 05:11:45,075 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/.tmp/cf/fa9a97a990ab42b7b7a1d539f2792985 2023-07-21 05:11:45,082 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/.tmp/cf/39e8c5cc12f84a0c8e885b25bbce3c61 2023-07-21 05:11:45,086 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/.tmp/cf/fa9a97a990ab42b7b7a1d539f2792985 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/cf/fa9a97a990ab42b7b7a1d539f2792985 2023-07-21 05:11:45,091 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/.tmp/cf/39e8c5cc12f84a0c8e885b25bbce3c61 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/cf/39e8c5cc12f84a0c8e885b25bbce3c61 2023-07-21 05:11:45,138 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/cf/fa9a97a990ab42b7b7a1d539f2792985, entries=6, sequenceid=6, filesize=5.9 K 2023-07-21 05:11:45,140 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 90f3bc1dc109e3c4d5f455bcefcb10d4 in 204ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:45,141 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 90f3bc1dc109e3c4d5f455bcefcb10d4: 2023-07-21 05:11:45,142 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,142 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:45,142 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/cf/fa9a97a990ab42b7b7a1d539f2792985] hfiles 2023-07-21 05:11:45,142 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/cf/fa9a97a990ab42b7b7a1d539f2792985 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,146 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/cf/39e8c5cc12f84a0c8e885b25bbce3c61, entries=44, sequenceid=6, filesize=12.6 K 2023-07-21 05:11:45,148 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 23f3df84c81de3a03a1fc714eb53ff67 in 229ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:45,148 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 23f3df84c81de3a03a1fc714eb53ff67: 2023-07-21 05:11:45,148 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,148 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:45,148 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/cf/39e8c5cc12f84a0c8e885b25bbce3c61] hfiles 2023-07-21 05:11:45,148 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/cf/39e8c5cc12f84a0c8e885b25bbce3c61 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,148 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:45,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:45,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:45,150 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:11:45,191 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. completed. 2023-07-21 05:11:45,191 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:45,191 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:45,191 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:45,191 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,191 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:45,191 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:11:45,193 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:45,193 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:45,193 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:45,193 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:11:45,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-21 05:11:45,210 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. completed. 2023-07-21 05:11:45,210 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:45,210 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:45,211 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:45,211 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,211 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-21 05:11:45,211 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:11:45,212 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-21 05:11:45,213 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:45,213 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-21 05:11:45,214 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:45,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,41899,1689916199499': 2023-07-21 05:11:45,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-21 05:11:45,220 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-21 05:11:45,220 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:45,220 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:45,220 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,220 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:45,225 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:45,225 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:45,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:45,225 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:45,226 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,226 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,227 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:45,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,229 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:45,230 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,231 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:45,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:45,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:45,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:45,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:45,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:45,235 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:45,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:45,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:45,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:45,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:45,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,235 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:11:45,237 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:45,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:45,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:45,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:45,237 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:45,237 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:45,238 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,238 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:45,238 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:45,238 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,238 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:45,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:45,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307216320a95356ad4f97ad9d9ff327e92fe0, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230721d49fd544cb50488b98c2aee7950fcd46] mob files 2023-07-21 05:11:45,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307216320a95356ad4f97ad9d9ff327e92fe0 2023-07-21 05:11:45,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230721d49fd544cb50488b98c2aee7950fcd46 2023-07-21 05:11:45,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,318 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-21 05:11:45,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,319 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689916304842Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689916305246 (+404 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689916305246Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689916305246Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689916305251 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689916305268 (+17 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689916305318 (+50 ms) 2023-07-21 05:11:45,322 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-21 05:11:45,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 478 msec 2023-07-21 05:11:45,450 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:45,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-21 05:11:45,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:45,452 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452 2023-07-21 05:11:45,452 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40289, tgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452, rawTgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452, srcFsUri=hdfs://localhost:40289, srcDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:11:45,482 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:11:45,482 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-997791698_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,482 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13, snapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-21 05:11:45,491 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:45,535 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:45,536 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:45,536 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:45,537 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:46,482 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0005_000001 (auth:SIMPLE) 2023-07-21 05:11:46,637 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-4653126625938805732.jar 2023-07-21 05:11:46,638 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:46,638 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:46,721 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-162761970585849918.jar 2023-07-21 05:11:46,722 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:46,722 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:46,723 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:46,723 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:46,724 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:46,724 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:46,725 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:11:46,726 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:11:46,726 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:11:46,727 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:11:46,727 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:11:46,728 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:11:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:11:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:11:46,729 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:11:46,730 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:11:46,731 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:46,732 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:46,732 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:46,733 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:46,733 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:46,734 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:46,735 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:47,680 WARN [Listener at jenkins-hbase4.apache.org/42887] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:11:47,683 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-21 05:11:47,838 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:47,838 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:11:47,961 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:11:48,060 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0006_000001 (auth:SIMPLE) 2023-07-21 05:11:53,309 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0006_000001 (auth:SIMPLE) 2023-07-21 05:11:56,159 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:11:56,160 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:11:56,167 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:56,167 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:11:56,168 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:11:56,168 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:56,169 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 05:11:56,169 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 05:11:56,169 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:56,169 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-21 05:11:56,169 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916305452/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-21 05:11:56,174 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 05:11:56,179 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916316179"}]},"ts":"1689916316179"} 2023-07-21 05:11:56,181 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-21 05:11:56,182 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-21 05:11:56,183 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=90f3bc1dc109e3c4d5f455bcefcb10d4, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=23f3df84c81de3a03a1fc714eb53ff67, UNASSIGN}] 2023-07-21 05:11:56,185 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=90f3bc1dc109e3c4d5f455bcefcb10d4, UNASSIGN 2023-07-21 05:11:56,186 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=23f3df84c81de3a03a1fc714eb53ff67, UNASSIGN 2023-07-21 05:11:56,186 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=23f3df84c81de3a03a1fc714eb53ff67, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:56,186 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=90f3bc1dc109e3c4d5f455bcefcb10d4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:56,187 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916316186"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916316186"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916316186"}]},"ts":"1689916316186"} 2023-07-21 05:11:56,187 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916316186"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916316186"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916316186"}]},"ts":"1689916316186"} 2023-07-21 05:11:56,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 23f3df84c81de3a03a1fc714eb53ff67, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:11:56,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 90f3bc1dc109e3c4d5f455bcefcb10d4, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:11:56,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 05:11:56,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:56,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:56,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 90f3bc1dc109e3c4d5f455bcefcb10d4, disabling compactions & flushes 2023-07-21 05:11:56,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 23f3df84c81de3a03a1fc714eb53ff67, disabling compactions & flushes 2023-07-21 05:11:56,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:56,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:56,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:56,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:56,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. after waiting 0 ms 2023-07-21 05:11:56,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:56,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. after waiting 0 ms 2023-07-21 05:11:56,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:56,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:56,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:11:56,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:56,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:11:56,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4. 2023-07-21 05:11:56,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67. 2023-07-21 05:11:56,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 90f3bc1dc109e3c4d5f455bcefcb10d4: 2023-07-21 05:11:56,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 23f3df84c81de3a03a1fc714eb53ff67: 2023-07-21 05:11:56,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:56,357 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=23f3df84c81de3a03a1fc714eb53ff67, regionState=CLOSED 2023-07-21 05:11:56,357 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916316357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916316357"}]},"ts":"1689916316357"} 2023-07-21 05:11:56,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:56,358 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=90f3bc1dc109e3c4d5f455bcefcb10d4, regionState=CLOSED 2023-07-21 05:11:56,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689916316358"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916316358"}]},"ts":"1689916316358"} 2023-07-21 05:11:56,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-21 05:11:56,364 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 23f3df84c81de3a03a1fc714eb53ff67, server=jenkins-hbase4.apache.org,41899,1689916199499 in 174 msec 2023-07-21 05:11:56,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-21 05:11:56,365 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 90f3bc1dc109e3c4d5f455bcefcb10d4, server=jenkins-hbase4.apache.org,34259,1689916199459 in 173 msec 2023-07-21 05:11:56,367 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=23f3df84c81de3a03a1fc714eb53ff67, UNASSIGN in 181 msec 2023-07-21 05:11:56,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-21 05:11:56,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=90f3bc1dc109e3c4d5f455bcefcb10d4, UNASSIGN in 182 msec 2023-07-21 05:11:56,372 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916316371"}]},"ts":"1689916316371"} 2023-07-21 05:11:56,373 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-21 05:11:56,375 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-21 05:11:56,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 201 msec 2023-07-21 05:11:56,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-21 05:11:56,481 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-21 05:11:56,482 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,486 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,487 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,490 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,492 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:56,492 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:56,494 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,494 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,494 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,494 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,494 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 05:11:56,494 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 05:11:56,494 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 05:11:56,495 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-21 05:11:56,495 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/recovered.edits] 2023-07-21 05:11:56,496 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/recovered.edits] 2023-07-21 05:11:56,496 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,496 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:56,496 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,497 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:56,496 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,497 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:56,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 05:11:56,496 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,497 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:56,502 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/cf/39e8c5cc12f84a0c8e885b25bbce3c61 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/cf/39e8c5cc12f84a0c8e885b25bbce3c61 2023-07-21 05:11:56,504 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/cf/fa9a97a990ab42b7b7a1d539f2792985 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/cf/fa9a97a990ab42b7b7a1d539f2792985 2023-07-21 05:11:56,507 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67/recovered.edits/9.seqid 2023-07-21 05:11:56,508 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/23f3df84c81de3a03a1fc714eb53ff67 2023-07-21 05:11:56,510 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4/recovered.edits/9.seqid 2023-07-21 05:11:56,511 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testEmptyExportFileSystemState/90f3bc1dc109e3c4d5f455bcefcb10d4 2023-07-21 05:11:56,511 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-21 05:11:56,512 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-21 05:11:56,513 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-21 05:11:56,518 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307216320a95356ad4f97ad9d9ff327e92fe0 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307216320a95356ad4f97ad9d9ff327e92fe0 2023-07-21 05:11:56,519 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230721d49fd544cb50488b98c2aee7950fcd46 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230721d49fd544cb50488b98c2aee7950fcd46 2023-07-21 05:11:56,520 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-21 05:11:56,527 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,530 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-21 05:11:56,537 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-21 05:11:56,538 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,538 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-21 05:11:56,538 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916316538"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:56,538 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916316538"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:56,542 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:11:56,542 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 90f3bc1dc109e3c4d5f455bcefcb10d4, NAME => 'testtb-testEmptyExportFileSystemState,,1689916303335.90f3bc1dc109e3c4d5f455bcefcb10d4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 23f3df84c81de3a03a1fc714eb53ff67, NAME => 'testtb-testEmptyExportFileSystemState,1,1689916303335.23f3df84c81de3a03a1fc714eb53ff67.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:11:56,542 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-21 05:11:56,543 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916316542"}]},"ts":"9223372036854775807"} 2023-07-21 05:11:56,549 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-21 05:11:56,557 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-21 05:11:56,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 75 msec 2023-07-21 05:11:56,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-21 05:11:56,599 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-21 05:11:56,607 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-21 05:11:56,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:56,611 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-21 05:11:56,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-21 05:11:56,646 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 755) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_861067949_1 at /127.0.0.1:43718 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1915921609) connection to jenkins-hbase4.apache.org/172.31.14.131:36751 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1915921609) connection to jenkins-hbase4.apache.org/172.31.14.131:46817 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:43742 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1915921609) connection to jenkins-hbase4.apache.org/172.31.14.131:41305 from appattempt_1689916208555_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:46274 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_861067949_1 at /127.0.0.1:46500 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2011516921_17 at /127.0.0.1:46514 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3a9d7326-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4787 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=921 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=714 (was 737), ProcessCount=188 (was 188), AvailableMemoryMB=1242 (was 1253) 2023-07-21 05:11:56,646 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-21 05:11:56,679 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=714, ProcessCount=188, AvailableMemoryMB=1225 2023-07-21 05:11:56,680 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-21 05:11:56,682 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-21 05:11:56,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:56,686 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-21 05:11:56,686 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-21 05:11:56,687 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-21 05:11:56,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 05:11:56,689 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba 2023-07-21 05:11:56,689 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372 2023-07-21 05:11:56,690 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372 empty. 2023-07-21 05:11:56,690 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba empty. 2023-07-21 05:11:56,691 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372 2023-07-21 05:11:56,691 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba 2023-07-21 05:11:56,691 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 05:11:56,705 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-21 05:11:56,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => c231114cfc273e4036b688d92fbc7372, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:11:56,716 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7e8808d6b9920d9031cece259947adba, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp 2023-07-21 05:11:56,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:56,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing c231114cfc273e4036b688d92fbc7372, disabling compactions & flushes 2023-07-21 05:11:56,751 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:56,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:56,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. after waiting 0 ms 2023-07-21 05:11:56,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:56,751 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:56,751 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for c231114cfc273e4036b688d92fbc7372: 2023-07-21 05:11:56,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:56,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 7e8808d6b9920d9031cece259947adba, disabling compactions & flushes 2023-07-21 05:11:56,759 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:56,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:56,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. after waiting 0 ms 2023-07-21 05:11:56,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:56,759 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:56,759 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 7e8808d6b9920d9031cece259947adba: 2023-07-21 05:11:56,761 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-21 05:11:56,762 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916316762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916316762"}]},"ts":"1689916316762"} 2023-07-21 05:11:56,762 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916316762"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916316762"}]},"ts":"1689916316762"} 2023-07-21 05:11:56,765 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-21 05:11:56,767 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-21 05:11:56,767 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916316767"}]},"ts":"1689916316767"} 2023-07-21 05:11:56,769 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-21 05:11:56,774 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-21 05:11:56,775 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-21 05:11:56,775 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-21 05:11:56,775 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-21 05:11:56,775 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-21 05:11:56,775 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c231114cfc273e4036b688d92fbc7372, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7e8808d6b9920d9031cece259947adba, ASSIGN}] 2023-07-21 05:11:56,781 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c231114cfc273e4036b688d92fbc7372, ASSIGN 2023-07-21 05:11:56,781 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7e8808d6b9920d9031cece259947adba, ASSIGN 2023-07-21 05:11:56,782 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c231114cfc273e4036b688d92fbc7372, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34259,1689916199459; forceNewPlan=false, retain=false 2023-07-21 05:11:56,782 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7e8808d6b9920d9031cece259947adba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41899,1689916199499; forceNewPlan=false, retain=false 2023-07-21 05:11:56,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 05:11:56,932 INFO [jenkins-hbase4:44111] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-21 05:11:56,935 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7e8808d6b9920d9031cece259947adba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:56,935 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c231114cfc273e4036b688d92fbc7372, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:56,936 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916316935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916316935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916316935"}]},"ts":"1689916316935"} 2023-07-21 05:11:56,936 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916316935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916316935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916316935"}]},"ts":"1689916316935"} 2023-07-21 05:11:56,939 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure c231114cfc273e4036b688d92fbc7372, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:11:56,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 7e8808d6b9920d9031cece259947adba, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:11:56,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 05:11:57,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:57,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c231114cfc273e4036b688d92fbc7372, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.', STARTKEY => '', ENDKEY => '1'} 2023-07-21 05:11:57,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. service=AccessControlService 2023-07-21 05:11:57,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:57,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c231114cfc273e4036b688d92fbc7372 2023-07-21 05:11:57,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:57,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c231114cfc273e4036b688d92fbc7372 2023-07-21 05:11:57,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c231114cfc273e4036b688d92fbc7372 2023-07-21 05:11:57,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:57,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7e8808d6b9920d9031cece259947adba, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.', STARTKEY => '1', ENDKEY => ''} 2023-07-21 05:11:57,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. service=AccessControlService 2023-07-21 05:11:57,096 INFO [StoreOpener-c231114cfc273e4036b688d92fbc7372-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c231114cfc273e4036b688d92fbc7372 2023-07-21 05:11:57,096 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-21 05:11:57,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7e8808d6b9920d9031cece259947adba 2023-07-21 05:11:57,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-21 05:11:57,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7e8808d6b9920d9031cece259947adba 2023-07-21 05:11:57,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7e8808d6b9920d9031cece259947adba 2023-07-21 05:11:57,098 DEBUG [StoreOpener-c231114cfc273e4036b688d92fbc7372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/cf 2023-07-21 05:11:57,098 INFO [StoreOpener-7e8808d6b9920d9031cece259947adba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7e8808d6b9920d9031cece259947adba 2023-07-21 05:11:57,098 DEBUG [StoreOpener-c231114cfc273e4036b688d92fbc7372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/cf 2023-07-21 05:11:57,098 INFO [StoreOpener-c231114cfc273e4036b688d92fbc7372-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c231114cfc273e4036b688d92fbc7372 columnFamilyName cf 2023-07-21 05:11:57,099 DEBUG [StoreOpener-7e8808d6b9920d9031cece259947adba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/cf 2023-07-21 05:11:57,099 DEBUG [StoreOpener-7e8808d6b9920d9031cece259947adba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/cf 2023-07-21 05:11:57,099 INFO [StoreOpener-7e8808d6b9920d9031cece259947adba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e8808d6b9920d9031cece259947adba columnFamilyName cf 2023-07-21 05:11:57,100 INFO [StoreOpener-c231114cfc273e4036b688d92fbc7372-1] regionserver.HStore(310): Store=c231114cfc273e4036b688d92fbc7372/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:57,100 INFO [StoreOpener-7e8808d6b9920d9031cece259947adba-1] regionserver.HStore(310): Store=7e8808d6b9920d9031cece259947adba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-21 05:11:57,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372 2023-07-21 05:11:57,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372 2023-07-21 05:11:57,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba 2023-07-21 05:11:57,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba 2023-07-21 05:11:57,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7e8808d6b9920d9031cece259947adba 2023-07-21 05:11:57,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c231114cfc273e4036b688d92fbc7372 2023-07-21 05:11:57,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:57,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7e8808d6b9920d9031cece259947adba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63326421, jitterRate=-0.05636279284954071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:57,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7e8808d6b9920d9031cece259947adba: 2023-07-21 05:11:57,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba., pid=109, masterSystemTime=1689916317093 2023-07-21 05:11:57,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-21 05:11:57,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:57,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:57,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c231114cfc273e4036b688d92fbc7372; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64381548, jitterRate=-0.040640175342559814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-21 05:11:57,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c231114cfc273e4036b688d92fbc7372: 2023-07-21 05:11:57,113 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7e8808d6b9920d9031cece259947adba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,113 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916317113"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916317113"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916317113"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916317113"}]},"ts":"1689916317113"} 2023-07-21 05:11:57,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372., pid=108, masterSystemTime=1689916317091 2023-07-21 05:11:57,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:57,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:57,115 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c231114cfc273e4036b688d92fbc7372, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,116 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916317115"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689916317115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689916317115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689916317115"}]},"ts":"1689916317115"} 2023-07-21 05:11:57,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-21 05:11:57,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 7e8808d6b9920d9031cece259947adba, server=jenkins-hbase4.apache.org,41899,1689916199499 in 173 msec 2023-07-21 05:11:57,118 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-21 05:11:57,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7e8808d6b9920d9031cece259947adba, ASSIGN in 342 msec 2023-07-21 05:11:57,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure c231114cfc273e4036b688d92fbc7372, server=jenkins-hbase4.apache.org,34259,1689916199459 in 178 msec 2023-07-21 05:11:57,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-21 05:11:57,121 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c231114cfc273e4036b688d92fbc7372, ASSIGN in 344 msec 2023-07-21 05:11:57,122 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-21 05:11:57,122 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916317122"}]},"ts":"1689916317122"} 2023-07-21 05:11:57,123 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-21 05:11:57,125 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-21 05:11:57,126 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-21 05:11:57,127 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 05:11:57,129 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:57,129 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:57,129 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:57,129 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:11:57,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:57,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:57,130 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:57,131 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-21 05:11:57,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 448 msec 2023-07-21 05:11:57,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-21 05:11:57,291 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-21 05:11:57,297 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,298 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:57,303 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:57,354 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:11:57,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916317354 (current time:1689916317354). 2023-07-21 05:11:57,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:57,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x1e6195a6 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:57,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42a6e774, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:57,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:57,393 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:57,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e6195a6 to 127.0.0.1:51418 2023-07-21 05:11:57,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:57,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x375d8a32 to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:57,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2503f5da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:57,426 DEBUG [hconnection-0x50eb2b49-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:57,436 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:57,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:57,443 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:57,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x375d8a32 to 127.0.0.1:51418 2023-07-21 05:11:57,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:57,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 05:11:57,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:57,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:11:57,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:11:57,452 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:11:57,453 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689916917453 2023-07-21 05:11:57,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:11:57,453 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,455 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:57,455 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:57,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:11:57,456 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:11:57,457 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-21 05:11:57,458 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:11:57,459 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689916917459 2023-07-21 05:11:57,536 WARN [DataStreamer for file /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-21 05:11:57,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,555 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 05:11:57,555 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:57,557 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 05:11:57,557 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 05:11:57,557 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:57,558 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,558 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:11:57,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:57,559 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:57,559 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:57,559 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:57,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:57,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:57,559 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:57,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:57,559 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:57,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:57,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:57,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,560 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,560 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,562 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,562 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:57,562 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 05:11:57,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 05:11:57,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:11:57,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:11:57,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-21 05:11:57,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,565 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:11:57,572 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,573 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:11:57,573 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:57,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:11:57,588 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:11:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:11:57,592 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:11:57,593 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:11:57,591 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:11:57,593 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:11:57,593 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:11:57,593 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:57,594 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:11:57,594 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:11:57,594 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:11:57,599 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,599 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,599 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:57,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:57,599 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:57,601 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:57,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 05:11:57,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40af235c[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:57,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:57,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:57,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 05:11:57,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40af235c[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:57,607 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 05:11:57,608 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:11:57,609 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,609 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:11:57,610 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:11:57,610 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:11:57,610 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:11:57,610 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,610 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,610 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:57,614 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:11:57,614 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:57,614 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:11:57,630 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:57,630 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:57,630 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:57,631 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. started... 2023-07-21 05:11:57,637 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7e8808d6b9920d9031cece259947adba: 2023-07-21 05:11:57,637 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,637 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:57,637 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:57,643 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:57,644 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:57,645 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:57,645 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. started... 2023-07-21 05:11:57,645 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c231114cfc273e4036b688d92fbc7372: 2023-07-21 05:11:57,645 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,645 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:57,645 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-21 05:11:57,723 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. completed. 2023-07-21 05:11:57,723 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:57,723 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:57,723 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:57,723 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,723 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:11:57,723 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:11:57,725 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,725 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:11:57,726 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:57,726 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:11:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:57,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41899,1689916199499': 2023-07-21 05:11:57,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 05:11:57,757 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. completed. 2023-07-21 05:11:57,757 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:57,757 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:57,757 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:57,757 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,757 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:11:57,757 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:11:57,759 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:57,760 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:11:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:57,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:57,760 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:11:57,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:11:57,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:57,763 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:11:57,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:57,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:57,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:11:57,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 05:11:57,768 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 05:11:57,768 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:57,768 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:57,769 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,769 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:57,771 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:57,771 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:57,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:57,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:57,772 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:57,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:57,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:57,773 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:57,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:57,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:57,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,774 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:57,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,776 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:57,777 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,777 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,781 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:57,781 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,781 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:57,781 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:57,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:57,781 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:57,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:57,781 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:57,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:57,781 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:57,782 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:11:57,782 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:57,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:57,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:57,782 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:57,782 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,783 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,783 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-21 05:11:57,783 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:57,783 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,783 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:57,783 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:57,783 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,783 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:57,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:57,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:57,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:57,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,889 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 05:11:57,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,890 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:57,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689916317453Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689916317805 (+352 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689916317805Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689916317805Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689916317812 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689916317840 (+28 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689916317889 (+49 ms) 2023-07-21 05:11:57,894 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:11:57,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 440 msec 2023-07-21 05:11:58,064 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:58,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:11:58,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:58,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34259] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:58,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41899] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-21 05:11:58,075 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,076 DEBUG [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:58,076 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-21 05:11:58,088 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:11:58,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689916318088 (current time:1689916318088). 2023-07-21 05:11:58,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-21 05:11:58,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x3c9c61ab to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:58,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3524b412, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:58,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:58,118 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:58,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c9c61ab to 127.0.0.1:51418 2023-07-21 05:11:58,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:58,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(139): Connect 0x567c1ddc to 127.0.0.1:51418 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-21 05:11:58,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@932af81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-21 05:11:58,128 DEBUG [hconnection-0x19a60e91-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:58,129 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:58,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-21 05:11:58,136 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-21 05:11:58,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x567c1ddc to 127.0.0.1:51418 2023-07-21 05:11:58,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:11:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-21 05:11:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-21 05:11:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:11:58,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:11:58,141 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:11:58,142 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689916918142 2023-07-21 05:11:58,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-21 05:11:58,142 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,143 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-21 05:11:58,144 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-21 05:11:58,145 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-21 05:11:58,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:11:58,146 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-21 05:11:58,147 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:11:58,147 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689916918147 2023-07-21 05:11:58,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,159 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-21 05:11:58,159 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:58,160 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-21 05:11:58,160 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-21 05:11:58,242 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,242 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,243 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:58,243 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:58,243 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:58,243 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:58,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:58,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:58,244 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,244 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:58,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:58,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:58,244 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,244 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,244 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-21 05:11:58,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:11:58,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:58,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 05:11:58,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,245 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-21 05:11:58,245 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:11:58,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 05:11:58,246 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,246 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:11:58,246 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:58,246 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:11:58,247 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:11:58,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-21 05:11:58,248 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:11:58,248 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:11:58,248 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:58,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,249 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:11:58,249 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:11:58,248 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42011,1689916199401' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:11:58,249 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-21 05:11:58,249 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:11:58,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,250 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-21 05:11:58,250 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-21 05:11:58,251 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-21 05:11:58,251 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-21 05:11:58,251 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-21 05:11:58,251 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,252 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,252 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,252 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,252 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:58,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:58,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:58,254 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,254 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:58,254 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,254 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:58,254 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,254 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-21 05:11:58,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:58,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:58,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34259,1689916199459' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 05:11:58,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f910717[Count = 1] remaining members to acquire global barrier 2023-07-21 05:11:58,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:58,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:58,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:58,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:58,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:58,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41899,1689916199499' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-21 05:11:58,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f910717[Count = 0] remaining members to acquire global barrier 2023-07-21 05:11:58,259 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-21 05:11:58,259 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,264 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,264 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,264 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,264 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,264 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:11:58,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:11:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:11:58,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42011,1689916199401' in zk 2023-07-21 05:11:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:58,265 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-21 05:11:58,265 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,265 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-21 05:11:58,265 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. started... 2023-07-21 05:11:58,265 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-21 05:11:58,266 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-21 05:11:58,266 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:58,266 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. started... 2023-07-21 05:11:58,266 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c231114cfc273e4036b688d92fbc7372 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-21 05:11:58,266 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7e8808d6b9920d9031cece259947adba 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-21 05:11:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:11:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:58,267 DEBUG [member: 'jenkins-hbase4.apache.org,42011,1689916199401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:11:58,284 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072149673b5bdd8e41898a617cd90f7a5805 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072149673b5bdd8e41898a617cd90f7a5805 2023-07-21 05:11:58,286 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230721e7d66712645a46ce998a23da9c624c63 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230721e7d66712645a46ce998a23da9c624c63 2023-07-21 05:11:58,319 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/.tmp/cf/05ca48f956c5446ca9799d7d0005bf4e 2023-07-21 05:11:58,325 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/.tmp/cf/05ca48f956c5446ca9799d7d0005bf4e as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/cf/05ca48f956c5446ca9799d7d0005bf4e 2023-07-21 05:11:58,331 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/cf/05ca48f956c5446ca9799d7d0005bf4e, entries=3, sequenceid=6, filesize=5.4 K 2023-07-21 05:11:58,332 INFO [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for c231114cfc273e4036b688d92fbc7372 in 66ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:58,332 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-21 05:11:58,333 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c231114cfc273e4036b688d92fbc7372: 2023-07-21 05:11:58,333 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,333 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:58,333 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/cf/05ca48f956c5446ca9799d7d0005bf4e] hfiles 2023-07-21 05:11:58,333 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/cf/05ca48f956c5446ca9799d7d0005bf4e for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,363 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/.tmp/cf/aa3ec4eb5e7949fc9aec13adb47dd972 2023-07-21 05:11:58,369 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/.tmp/cf/aa3ec4eb5e7949fc9aec13adb47dd972 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/cf/aa3ec4eb5e7949fc9aec13adb47dd972 2023-07-21 05:11:58,370 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. completed. 2023-07-21 05:11:58,370 DEBUG [rs(jenkins-hbase4.apache.org,34259,1689916199459)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:11:58,370 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:58,370 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:58,370 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,370 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:11:58,370 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34259,1689916199459' in zk 2023-07-21 05:11:58,373 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:58,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:58,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:58,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:58,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,374 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:11:58,374 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:58,374 DEBUG [member: 'jenkins-hbase4.apache.org,34259,1689916199459' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:11:58,374 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/cf/aa3ec4eb5e7949fc9aec13adb47dd972, entries=47, sequenceid=6, filesize=13.3 K 2023-07-21 05:11:58,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:58,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34259,1689916199459': 2023-07-21 05:11:58,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34259,1689916199459' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-21 05:11:58,381 INFO [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 7e8808d6b9920d9031cece259947adba in 115ms, sequenceid=6, compaction requested=false 2023-07-21 05:11:58,382 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7e8808d6b9920d9031cece259947adba: 2023-07-21 05:11:58,383 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,383 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-21 05:11:58,383 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/cf/aa3ec4eb5e7949fc9aec13adb47dd972] hfiles 2023-07-21 05:11:58,383 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/cf/aa3ec4eb5e7949fc9aec13adb47dd972 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,393 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. completed. 2023-07-21 05:11:58,393 DEBUG [rs(jenkins-hbase4.apache.org,41899,1689916199499)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:11:58,393 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-21 05:11:58,393 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-21 05:11:58,393 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,393 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-21 05:11:58,393 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41899,1689916199499' in zk 2023-07-21 05:11:58,395 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-21 05:11:58,395 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,395 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:58,395 DEBUG [member: 'jenkins-hbase4.apache.org,41899,1689916199499' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-21 05:11:58,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:58,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:58,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:58,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:58,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41899,1689916199499': 2023-07-21 05:11:58,405 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41899,1689916199499' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-21 05:11:58,405 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-21 05:11:58,405 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-21 05:11:58,405 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-21 05:11:58,405 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,405 INFO [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-21 05:11:58,407 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-21 05:11:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-21 05:11:58,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:58,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:58,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:58,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:58,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:58,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-21 05:11:58,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,408 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:58,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,409 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-21 05:11:58,410 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,412 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-21 05:11:58,412 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,412 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,415 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,415 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,415 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:58,415 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,415 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:58,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:58,415 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:58,415 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-21 05:11:58,415 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:58,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:58,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:58,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-21 05:11:58,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-21 05:11:58,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:58,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-21 05:11:58,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:11:58,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,416 DEBUG [(jenkins-hbase4.apache.org,44111,1689916197930)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-21 05:11:58,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:11:58,416 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,416 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:58,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:58,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:58,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-21 05:11:58,416 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:11:58,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:58,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-21 05:11:58,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-21 05:11:58,418 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,418 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230721e7d66712645a46ce998a23da9c624c63, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072149673b5bdd8e41898a617cd90f7a5805] mob files 2023-07-21 05:11:58,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230721e7d66712645a46ce998a23da9c624c63 2023-07-21 05:11:58,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072149673b5bdd8e41898a617cd90f7a5805 2023-07-21 05:11:58,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,445 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:58,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:11:58,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-21 05:11:58,447 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-21 05:11:58,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-21 05:11:58,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,507 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689916318142Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689916318430 (+288 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689916318430Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689916318430Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689916318438 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689916318448 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689916318506 (+58 ms) 2023-07-21 05:11:58,510 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-21 05:11:58,511 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 367 msec 2023-07-21 05:11:58,747 DEBUG [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-21 05:11:58,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-21 05:11:58,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-21 05:11:58,748 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748 2023-07-21 05:11:58,749 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40289, tgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748, rawTgtDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748, srcFsUri=hdfs://localhost:40289, srcDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:11:58,771 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13 2023-07-21 05:11:58,771 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1565167399_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,771 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40289, inputRoot=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13, snapshotDir=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-21 05:11:58,779 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:11:58,802 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:58,802 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:58,802 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:58,803 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:59,914 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-3394723988976385260.jar 2023-07-21 05:11:59,915 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:59,915 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:59,987 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/hadoop-8661571530819253791.jar 2023-07-21 05:11:59,988 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:59,988 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:59,989 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:59,989 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:59,989 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:59,990 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-21 05:11:59,990 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-21 05:11:59,991 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-21 05:11:59,991 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-21 05:11:59,991 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-21 05:11:59,992 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-21 05:11:59,992 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-21 05:11:59,992 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-21 05:11:59,993 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-21 05:11:59,993 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-21 05:11:59,994 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-21 05:11:59,994 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:59,995 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:59,995 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:59,996 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:59,996 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-21 05:11:59,996 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:11:59,997 DEBUG [Listener at jenkins-hbase4.apache.org/42887] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-21 05:12:00,692 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0006_000001 (auth:SIMPLE) 2023-07-21 05:12:00,817 WARN [Listener at jenkins-hbase4.apache.org/42887] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-21 05:12:00,819 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-21 05:12:00,821 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-21 05:12:00,906 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:12:00,906 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-21 05:12:01,500 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0007_000001 (auth:SIMPLE) 2023-07-21 05:12:01,968 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:12:07,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0007_000001 (auth:SIMPLE) 2023-07-21 05:12:10,096 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0007_000001 (auth:SIMPLE) 2023-07-21 05:12:15,012 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689916208555_0007_000001 (auth:SIMPLE) 2023-07-21 05:12:16,078 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-21 05:12:16,078 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-21 05:12:16,095 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,096 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-21 05:12:16,096 INFO [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-21 05:12:16,096 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,097 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 05:12:16,097 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 05:12:16,097 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2011516921_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,098 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-21 05:12:16,098 DEBUG [Listener at jenkins-hbase4.apache.org/42887] snapshot.TestExportSnapshot(367): hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/export-test/export-1689916318748/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-21 05:12:16,107 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,108 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,113 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916336113"}]},"ts":"1689916336113"} 2023-07-21 05:12:16,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 05:12:16,115 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-21 05:12:16,116 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-21 05:12:16,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c231114cfc273e4036b688d92fbc7372, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7e8808d6b9920d9031cece259947adba, UNASSIGN}] 2023-07-21 05:12:16,119 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c231114cfc273e4036b688d92fbc7372, UNASSIGN 2023-07-21 05:12:16,119 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7e8808d6b9920d9031cece259947adba, UNASSIGN 2023-07-21 05:12:16,121 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c231114cfc273e4036b688d92fbc7372, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:12:16,121 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=7e8808d6b9920d9031cece259947adba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:12:16,122 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916336121"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916336121"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916336121"}]},"ts":"1689916336121"} 2023-07-21 05:12:16,122 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916336121"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689916336121"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689916336121"}]},"ts":"1689916336121"} 2023-07-21 05:12:16,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure c231114cfc273e4036b688d92fbc7372, server=jenkins-hbase4.apache.org,34259,1689916199459}] 2023-07-21 05:12:16,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 7e8808d6b9920d9031cece259947adba, server=jenkins-hbase4.apache.org,41899,1689916199499}] 2023-07-21 05:12:16,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 05:12:16,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c231114cfc273e4036b688d92fbc7372 2023-07-21 05:12:16,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c231114cfc273e4036b688d92fbc7372, disabling compactions & flushes 2023-07-21 05:12:16,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:12:16,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:12:16,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. after waiting 0 ms 2023-07-21 05:12:16,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:12:16,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7e8808d6b9920d9031cece259947adba 2023-07-21 05:12:16,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7e8808d6b9920d9031cece259947adba, disabling compactions & flushes 2023-07-21 05:12:16,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:12:16,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:12:16,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. after waiting 0 ms 2023-07-21 05:12:16,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:12:16,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:12:16,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:12:16,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:16,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372. 2023-07-21 05:12:16,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c231114cfc273e4036b688d92fbc7372: 2023-07-21 05:12:16,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:16,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba. 2023-07-21 05:12:16,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7e8808d6b9920d9031cece259947adba: 2023-07-21 05:12:16,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c231114cfc273e4036b688d92fbc7372 2023-07-21 05:12:16,308 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c231114cfc273e4036b688d92fbc7372, regionState=CLOSED 2023-07-21 05:12:16,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7e8808d6b9920d9031cece259947adba 2023-07-21 05:12:16,308 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916336307"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916336307"}]},"ts":"1689916336307"} 2023-07-21 05:12:16,308 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=7e8808d6b9920d9031cece259947adba, regionState=CLOSED 2023-07-21 05:12:16,309 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689916336308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689916336308"}]},"ts":"1689916336308"} 2023-07-21 05:12:16,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-21 05:12:16,311 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure c231114cfc273e4036b688d92fbc7372, server=jenkins-hbase4.apache.org,34259,1689916199459 in 186 msec 2023-07-21 05:12:16,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-21 05:12:16,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 7e8808d6b9920d9031cece259947adba, server=jenkins-hbase4.apache.org,41899,1689916199499 in 186 msec 2023-07-21 05:12:16,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c231114cfc273e4036b688d92fbc7372, UNASSIGN in 194 msec 2023-07-21 05:12:16,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-21 05:12:16,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7e8808d6b9920d9031cece259947adba, UNASSIGN in 195 msec 2023-07-21 05:12:16,314 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689916336314"}]},"ts":"1689916336314"} 2023-07-21 05:12:16,315 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-21 05:12:16,317 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-21 05:12:16,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 209 msec 2023-07-21 05:12:16,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-21 05:12:16,416 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-21 05:12:16,417 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,420 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,422 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,428 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372 2023-07-21 05:12:16,428 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba 2023-07-21 05:12:16,430 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34259] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,430 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/recovered.edits] 2023-07-21 05:12:16,430 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/cf, FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/recovered.edits] 2023-07-21 05:12:16,434 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,434 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,434 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,434 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 05:12:16,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 05:12:16,435 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-21 05:12:16,436 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,436 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:16,436 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,436 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:16,436 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:16,436 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,436 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-21 05:12:16,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 05:12:16,441 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-21 05:12:16,442 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-21 05:12:16,443 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/cf/05ca48f956c5446ca9799d7d0005bf4e to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/cf/05ca48f956c5446ca9799d7d0005bf4e 2023-07-21 05:12:16,445 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/cf/aa3ec4eb5e7949fc9aec13adb47dd972 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/cf/aa3ec4eb5e7949fc9aec13adb47dd972 2023-07-21 05:12:16,450 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372/recovered.edits/9.seqid 2023-07-21 05:12:16,451 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c231114cfc273e4036b688d92fbc7372 2023-07-21 05:12:16,451 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/recovered.edits/9.seqid to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba/recovered.edits/9.seqid 2023-07-21 05:12:16,451 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7e8808d6b9920d9031cece259947adba 2023-07-21 05:12:16,451 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-21 05:12:16,452 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-21 05:12:16,452 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-21 05:12:16,455 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230721e7d66712645a46ce998a23da9c624c63 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230721e7d66712645a46ce998a23da9c624c63 2023-07-21 05:12:16,458 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072149673b5bdd8e41898a617cd90f7a5805 to hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023072149673b5bdd8e41898a617cd90f7a5805 2023-07-21 05:12:16,459 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-21 05:12:16,461 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,464 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-21 05:12:16,466 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-21 05:12:16,467 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,467 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-21 05:12:16,467 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916336467"}]},"ts":"9223372036854775807"} 2023-07-21 05:12:16,467 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689916336467"}]},"ts":"9223372036854775807"} 2023-07-21 05:12:16,469 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-21 05:12:16,469 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c231114cfc273e4036b688d92fbc7372, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689916316681.c231114cfc273e4036b688d92fbc7372.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7e8808d6b9920d9031cece259947adba, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689916316681.7e8808d6b9920d9031cece259947adba.', STARTKEY => '1', ENDKEY => ''}] 2023-07-21 05:12:16,469 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-21 05:12:16,469 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689916336469"}]},"ts":"9223372036854775807"} 2023-07-21 05:12:16,471 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-21 05:12:16,473 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 56 msec 2023-07-21 05:12:16,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-21 05:12:16,539 INFO [Listener at jenkins-hbase4.apache.org/42887] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-21 05:12:16,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 05:12:16,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-21 05:12:16,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44111] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-21 05:12:16,582 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760 (was 760), OpenFileDescriptor=899 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=779 (was 714) - SystemLoadAverage LEAK? -, ProcessCount=191 (was 188) - ProcessCount LEAK? -, AvailableMemoryMB=1898 (was 1225) - AvailableMemoryMB LEAK? - 2023-07-21 05:12:16,583 WARN [Listener at jenkins-hbase4.apache.org/42887] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-21 05:12:16,583 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-21 05:12:16,595 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 05:12:16,708 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689916208555_0007_01_000001 is : 143 2023-07-21 05:12:21,870 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-21 05:12:30,723 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 05:12:44,840 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 05:12:44,841 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 05:12:44,950 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-21 05:12:44,961 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-21 05:12:44,962 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 05:12:44,973 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-21 05:12:45,078 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-21 05:12:45,078 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-21 05:12:45,078 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-21 05:12:45,079 INFO [Listener at jenkins-hbase4.apache.org/42887] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-21 05:12:45,079 DEBUG [Listener at jenkins-hbase4.apache.org/42887] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x019b73aa to 127.0.0.1:51418 2023-07-21 05:12:45,079 DEBUG [Listener at jenkins-hbase4.apache.org/42887] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:45,080 DEBUG [Listener at jenkins-hbase4.apache.org/42887] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-21 05:12:45,080 DEBUG [Listener at jenkins-hbase4.apache.org/42887] util.JVMClusterUtil(257): Found active master hash=549704716, stopped=false 2023-07-21 05:12:45,080 DEBUG [Listener at jenkins-hbase4.apache.org/42887] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:45,080 DEBUG [Listener at jenkins-hbase4.apache.org/42887] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-21 05:12:45,081 INFO [Listener at jenkins-hbase4.apache.org/42887] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:12:45,082 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 05:12:45,082 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 05:12:45,082 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:12:45,082 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 05:12:45,082 INFO [Listener at jenkins-hbase4.apache.org/42887] procedure2.ProcedureExecutor(629): Stopping 2023-07-21 05:12:45,082 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-21 05:12:45,083 DEBUG [Listener at jenkins-hbase4.apache.org/42887] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06ecf4b9 to 127.0.0.1:51418 2023-07-21 05:12:45,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:12:45,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:12:45,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:12:45,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-21 05:12:45,084 DEBUG [Listener at jenkins-hbase4.apache.org/42887] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:45,084 INFO [Listener at jenkins-hbase4.apache.org/42887] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42011,1689916199401' ***** 2023-07-21 05:12:45,084 DEBUG [Listener at jenkins-hbase4.apache.org/42887] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:45,084 INFO [Listener at jenkins-hbase4.apache.org/42887] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 05:12:45,085 INFO [Listener at jenkins-hbase4.apache.org/42887] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34259,1689916199459' ***** 2023-07-21 05:12:45,085 DEBUG [Listener at jenkins-hbase4.apache.org/42887] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:45,085 INFO [Listener at jenkins-hbase4.apache.org/42887] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 05:12:45,085 INFO [RS:0;jenkins-hbase4:42011] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 05:12:45,085 INFO [Listener at jenkins-hbase4.apache.org/42887] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41899,1689916199499' ***** 2023-07-21 05:12:45,085 INFO [RS:1;jenkins-hbase4:34259] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 05:12:45,085 INFO [RS:1;jenkins-hbase4:34259] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 05:12:45,085 DEBUG [Listener at jenkins-hbase4.apache.org/42887] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:45,085 INFO [RS:1;jenkins-hbase4:34259] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 05:12:45,085 INFO [RS:0;jenkins-hbase4:42011] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 05:12:45,085 INFO [Listener at jenkins-hbase4.apache.org/42887] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-21 05:12:45,085 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 05:12:45,085 INFO [RS:0;jenkins-hbase4:42011] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 05:12:45,085 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(3305): Received CLOSE for ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:12:45,085 INFO [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:12:45,085 INFO [RS:2;jenkins-hbase4:41899] regionserver.HeapMemoryManager(220): Stopping 2023-07-21 05:12:45,086 DEBUG [RS:0;jenkins-hbase4:42011] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x014c910c to 127.0.0.1:51418 2023-07-21 05:12:45,086 DEBUG [RS:0;jenkins-hbase4:42011] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:45,086 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 05:12:45,086 INFO [RS:2;jenkins-hbase4:41899] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-21 05:12:45,086 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(3305): Received CLOSE for 9cd2fbb292b580362c0bf2caed0c17ef 2023-07-21 05:12:45,086 INFO [RS:2;jenkins-hbase4:41899] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-21 05:12:45,086 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-21 05:12:45,086 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:12:45,086 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:12:45,089 INFO [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42011,1689916199401; all regions closed. 2023-07-21 05:12:45,089 DEBUG [RS:2;jenkins-hbase4:41899] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x280df3d3 to 127.0.0.1:51418 2023-07-21 05:12:45,089 DEBUG [RS:1;jenkins-hbase4:34259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73138f78 to 127.0.0.1:51418 2023-07-21 05:12:45,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea4e10d61fe9dcc96a189a79e7ebb45d, disabling compactions & flushes 2023-07-21 05:12:45,089 DEBUG [RS:1;jenkins-hbase4:34259] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:45,089 DEBUG [RS:2;jenkins-hbase4:41899] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:45,089 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:12:45,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:12:45,090 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-21 05:12:45,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. after waiting 0 ms 2023-07-21 05:12:45,090 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1478): Online Regions={ea4e10d61fe9dcc96a189a79e7ebb45d=hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d., 9cd2fbb292b580362c0bf2caed0c17ef=hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef.} 2023-07-21 05:12:45,090 INFO [RS:2;jenkins-hbase4:41899] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 05:12:45,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:12:45,090 INFO [RS:2;jenkins-hbase4:41899] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 05:12:45,090 INFO [RS:2;jenkins-hbase4:41899] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 05:12:45,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ea4e10d61fe9dcc96a189a79e7ebb45d 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-21 05:12:45,090 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-21 05:12:45,091 DEBUG [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1504): Waiting on 9cd2fbb292b580362c0bf2caed0c17ef, ea4e10d61fe9dcc96a189a79e7ebb45d 2023-07-21 05:12:45,094 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-21 05:12:45,094 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-21 05:12:45,095 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-21 05:12:45,095 DEBUG [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-21 05:12:45,095 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-21 05:12:45,096 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-21 05:12:45,096 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-21 05:12:45,096 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-21 05:12:45,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-21 05:12:45,109 DEBUG [RS:0;jenkins-hbase4:42011] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/oldWALs 2023-07-21 05:12:45,109 INFO [RS:0;jenkins-hbase4:42011] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42011%2C1689916199401:(num 1689916201701) 2023-07-21 05:12:45,109 DEBUG [RS:0;jenkins-hbase4:42011] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:45,109 INFO [RS:0;jenkins-hbase4:42011] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:45,109 INFO [RS:0;jenkins-hbase4:42011] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 05:12:45,109 INFO [RS:0;jenkins-hbase4:42011] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 05:12:45,109 INFO [RS:0;jenkins-hbase4:42011] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 05:12:45,109 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 05:12:45,109 INFO [RS:0;jenkins-hbase4:42011] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 05:12:45,110 INFO [RS:0;jenkins-hbase4:42011] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42011 2023-07-21 05:12:45,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d/.tmp/l/91ab5733d7814143b65e5f68efa03802 2023-07-21 05:12:45,117 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:45,118 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:12:45,118 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:45,118 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:12:45,118 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:45,118 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42011,1689916199401 2023-07-21 05:12:45,118 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:45,118 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:45,119 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42011,1689916199401] 2023-07-21 05:12:45,119 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42011,1689916199401; numProcessing=1 2023-07-21 05:12:45,121 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/.tmp/info/3c657e08927f49ddae1aab5c5c479427 2023-07-21 05:12:45,122 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42011,1689916199401 already deleted, retry=false 2023-07-21 05:12:45,122 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42011,1689916199401 expired; onlineServers=2 2023-07-21 05:12:45,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91ab5733d7814143b65e5f68efa03802 2023-07-21 05:12:45,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d/.tmp/l/91ab5733d7814143b65e5f68efa03802 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d/l/91ab5733d7814143b65e5f68efa03802 2023-07-21 05:12:45,125 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c657e08927f49ddae1aab5c5c479427 2023-07-21 05:12:45,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91ab5733d7814143b65e5f68efa03802 2023-07-21 05:12:45,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d/l/91ab5733d7814143b65e5f68efa03802, entries=7, sequenceid=18, filesize=5.2 K 2023-07-21 05:12:45,128 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:45,129 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ea4e10d61fe9dcc96a189a79e7ebb45d in 39ms, sequenceid=18, compaction requested=false 2023-07-21 05:12:45,134 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:45,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/acl/ea4e10d61fe9dcc96a189a79e7ebb45d/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-21 05:12:45,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:45,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:12:45,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea4e10d61fe9dcc96a189a79e7ebb45d: 2023-07-21 05:12:45,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689916203083.ea4e10d61fe9dcc96a189a79e7ebb45d. 2023-07-21 05:12:45,138 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/.tmp/rep_barrier/71d7b1a2726d44dca1c2f06c83074498 2023-07-21 05:12:45,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9cd2fbb292b580362c0bf2caed0c17ef, disabling compactions & flushes 2023-07-21 05:12:45,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:12:45,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:12:45,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. after waiting 0 ms 2023-07-21 05:12:45,139 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:12:45,139 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9cd2fbb292b580362c0bf2caed0c17ef 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-21 05:12:45,142 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71d7b1a2726d44dca1c2f06c83074498 2023-07-21 05:12:45,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef/.tmp/info/857c908e140048899d047d73ef2d919c 2023-07-21 05:12:45,157 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/.tmp/table/7049aad869c8448182eef96413e99771 2023-07-21 05:12:45,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7049aad869c8448182eef96413e99771 2023-07-21 05:12:45,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef/.tmp/info/857c908e140048899d047d73ef2d919c as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef/info/857c908e140048899d047d73ef2d919c 2023-07-21 05:12:45,162 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/.tmp/info/3c657e08927f49ddae1aab5c5c479427 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/info/3c657e08927f49ddae1aab5c5c479427 2023-07-21 05:12:45,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c657e08927f49ddae1aab5c5c479427 2023-07-21 05:12:45,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/info/3c657e08927f49ddae1aab5c5c479427, entries=48, sequenceid=131, filesize=10.3 K 2023-07-21 05:12:45,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef/info/857c908e140048899d047d73ef2d919c, entries=2, sequenceid=6, filesize=4.8 K 2023-07-21 05:12:45,167 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/.tmp/rep_barrier/71d7b1a2726d44dca1c2f06c83074498 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/rep_barrier/71d7b1a2726d44dca1c2f06c83074498 2023-07-21 05:12:45,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9cd2fbb292b580362c0bf2caed0c17ef in 28ms, sequenceid=6, compaction requested=false 2023-07-21 05:12:45,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/namespace/9cd2fbb292b580362c0bf2caed0c17ef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-21 05:12:45,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:45,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:12:45,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9cd2fbb292b580362c0bf2caed0c17ef: 2023-07-21 05:12:45,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689916202298.9cd2fbb292b580362c0bf2caed0c17ef. 2023-07-21 05:12:45,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 71d7b1a2726d44dca1c2f06c83074498 2023-07-21 05:12:45,173 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/rep_barrier/71d7b1a2726d44dca1c2f06c83074498, entries=13, sequenceid=131, filesize=6.4 K 2023-07-21 05:12:45,173 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/.tmp/table/7049aad869c8448182eef96413e99771 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/table/7049aad869c8448182eef96413e99771 2023-07-21 05:12:45,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7049aad869c8448182eef96413e99771 2023-07-21 05:12:45,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/table/7049aad869c8448182eef96413e99771, entries=24, sequenceid=131, filesize=6.9 K 2023-07-21 05:12:45,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 81ms, sequenceid=131, compaction requested=false 2023-07-21 05:12:45,185 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-21 05:12:45,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-21 05:12:45,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-21 05:12:45,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-21 05:12:45,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-21 05:12:45,187 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-21 05:12:45,220 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:45,220 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:42011-0x10186494b5a0001, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:45,220 INFO [RS:0;jenkins-hbase4:42011] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42011,1689916199401; zookeeper connection closed. 2023-07-21 05:12:45,220 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1f11c333] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1f11c333 2023-07-21 05:12:45,291 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34259,1689916199459; all regions closed. 2023-07-21 05:12:45,296 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41899,1689916199499; all regions closed. 2023-07-21 05:12:45,298 DEBUG [RS:1;jenkins-hbase4:34259] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/oldWALs 2023-07-21 05:12:45,298 INFO [RS:1;jenkins-hbase4:34259] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34259%2C1689916199459:(num 1689916201701) 2023-07-21 05:12:45,298 DEBUG [RS:1;jenkins-hbase4:34259] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:45,298 INFO [RS:1;jenkins-hbase4:34259] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:45,301 DEBUG [RS:2;jenkins-hbase4:41899] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/oldWALs 2023-07-21 05:12:45,301 INFO [RS:2;jenkins-hbase4:41899] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41899%2C1689916199499.meta:.meta(num 1689916201914) 2023-07-21 05:12:45,303 INFO [RS:1;jenkins-hbase4:34259] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-21 05:12:45,304 INFO [RS:1;jenkins-hbase4:34259] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-21 05:12:45,304 INFO [RS:1;jenkins-hbase4:34259] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-21 05:12:45,304 INFO [RS:1;jenkins-hbase4:34259] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-21 05:12:45,304 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 05:12:45,305 INFO [RS:1;jenkins-hbase4:34259] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34259 2023-07-21 05:12:45,307 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:12:45,307 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:45,307 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34259,1689916199459 2023-07-21 05:12:45,308 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34259,1689916199459] 2023-07-21 05:12:45,308 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34259,1689916199459; numProcessing=2 2023-07-21 05:12:45,309 DEBUG [RS:2;jenkins-hbase4:41899] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/oldWALs 2023-07-21 05:12:45,309 INFO [RS:2;jenkins-hbase4:41899] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41899%2C1689916199499:(num 1689916201701) 2023-07-21 05:12:45,309 DEBUG [RS:2;jenkins-hbase4:41899] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:45,309 INFO [RS:2;jenkins-hbase4:41899] regionserver.LeaseManager(133): Closed leases 2023-07-21 05:12:45,309 INFO [RS:2;jenkins-hbase4:41899] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-21 05:12:45,309 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 05:12:45,310 INFO [RS:2;jenkins-hbase4:41899] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41899 2023-07-21 05:12:45,310 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34259,1689916199459 already deleted, retry=false 2023-07-21 05:12:45,310 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34259,1689916199459 expired; onlineServers=1 2023-07-21 05:12:45,312 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41899,1689916199499 2023-07-21 05:12:45,312 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-21 05:12:45,314 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41899,1689916199499] 2023-07-21 05:12:45,314 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41899,1689916199499; numProcessing=3 2023-07-21 05:12:45,315 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41899,1689916199499 already deleted, retry=false 2023-07-21 05:12:45,315 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41899,1689916199499 expired; onlineServers=0 2023-07-21 05:12:45,315 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44111,1689916197930' ***** 2023-07-21 05:12:45,315 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-21 05:12:45,315 DEBUG [M:0;jenkins-hbase4:44111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61fede37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-21 05:12:45,315 INFO [M:0;jenkins-hbase4:44111] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44111,1689916197930 2023-07-21 05:12:45,315 INFO [M:0;jenkins-hbase4:44111] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44111,1689916197930; all regions closed. 2023-07-21 05:12:45,315 DEBUG [M:0;jenkins-hbase4:44111] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-21 05:12:45,315 DEBUG [M:0;jenkins-hbase4:44111] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-21 05:12:45,315 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-21 05:12:45,315 DEBUG [M:0;jenkins-hbase4:44111] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-21 05:12:45,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689916201200] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689916201200,5,FailOnTimeoutGroup] 2023-07-21 05:12:45,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689916201184] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689916201184,5,FailOnTimeoutGroup] 2023-07-21 05:12:45,315 INFO [M:0;jenkins-hbase4:44111] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-21 05:12:45,316 INFO [M:0;jenkins-hbase4:44111] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-21 05:12:45,316 INFO [M:0;jenkins-hbase4:44111] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-21 05:12:45,316 DEBUG [M:0;jenkins-hbase4:44111] master.HMaster(1512): Stopping service threads 2023-07-21 05:12:45,316 INFO [M:0;jenkins-hbase4:44111] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-21 05:12:45,316 ERROR [M:0;jenkins-hbase4:44111] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-21 05:12:45,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-21 05:12:45,316 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-21 05:12:45,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-21 05:12:45,317 INFO [M:0;jenkins-hbase4:44111] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-21 05:12:45,317 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-21 05:12:45,317 DEBUG [M:0;jenkins-hbase4:44111] zookeeper.ZKUtil(398): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-21 05:12:45,317 WARN [M:0;jenkins-hbase4:44111] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-21 05:12:45,317 INFO [M:0;jenkins-hbase4:44111] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-21 05:12:45,317 INFO [M:0;jenkins-hbase4:44111] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-21 05:12:45,318 DEBUG [M:0;jenkins-hbase4:44111] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-21 05:12:45,318 INFO [M:0;jenkins-hbase4:44111] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:12:45,318 DEBUG [M:0;jenkins-hbase4:44111] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:12:45,318 DEBUG [M:0;jenkins-hbase4:44111] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-21 05:12:45,318 DEBUG [M:0;jenkins-hbase4:44111] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:12:45,318 INFO [M:0;jenkins-hbase4:44111] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.68 KB heapSize=451.98 KB 2023-07-21 05:12:45,335 INFO [M:0;jenkins-hbase4:44111] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.68 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2803793c1e5d499a9ea3ba16b544f030 2023-07-21 05:12:45,338 INFO [M:0;jenkins-hbase4:44111] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2803793c1e5d499a9ea3ba16b544f030 2023-07-21 05:12:45,339 DEBUG [M:0;jenkins-hbase4:44111] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/2803793c1e5d499a9ea3ba16b544f030 as hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2803793c1e5d499a9ea3ba16b544f030 2023-07-21 05:12:45,343 INFO [M:0;jenkins-hbase4:44111] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2803793c1e5d499a9ea3ba16b544f030 2023-07-21 05:12:45,343 INFO [M:0;jenkins-hbase4:44111] regionserver.HStore(1080): Added hdfs://localhost:40289/user/jenkins/test-data/ed8d46e8-f5c6-e7db-1f39-524441efce13/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/2803793c1e5d499a9ea3ba16b544f030, entries=119, sequenceid=899, filesize=28.6 K 2023-07-21 05:12:45,343 INFO [M:0;jenkins-hbase4:44111] regionserver.HRegion(2948): Finished flush of dataSize ~375.68 KB/384695, heapSize ~451.97 KB/462816, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=899, compaction requested=false 2023-07-21 05:12:45,345 INFO [M:0;jenkins-hbase4:44111] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-21 05:12:45,345 DEBUG [M:0;jenkins-hbase4:44111] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-21 05:12:45,348 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-21 05:12:45,348 INFO [M:0;jenkins-hbase4:44111] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-21 05:12:45,351 INFO [M:0;jenkins-hbase4:44111] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44111 2023-07-21 05:12:45,353 DEBUG [M:0;jenkins-hbase4:44111] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44111,1689916197930 already deleted, retry=false 2023-07-21 05:12:45,408 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:45,408 INFO [RS:1;jenkins-hbase4:34259] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34259,1689916199459; zookeeper connection closed. 2023-07-21 05:12:45,409 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:34259-0x10186494b5a0002, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:45,409 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5e9ffab0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5e9ffab0 2023-07-21 05:12:45,509 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:45,509 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): master:44111-0x10186494b5a0000, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:45,509 INFO [M:0;jenkins-hbase4:44111] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44111,1689916197930; zookeeper connection closed. 2023-07-21 05:12:45,609 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:45,609 INFO [RS:2;jenkins-hbase4:41899] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41899,1689916199499; zookeeper connection closed. 2023-07-21 05:12:45,609 DEBUG [Listener at localhost/40309-EventThread] zookeeper.ZKWatcher(600): regionserver:41899-0x10186494b5a0003, quorum=127.0.0.1:51418, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-21 05:12:45,609 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7e87ab2a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7e87ab2a 2023-07-21 05:12:45,609 INFO [Listener at jenkins-hbase4.apache.org/42887] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-21 05:12:45,610 WARN [Listener at jenkins-hbase4.apache.org/42887] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 05:12:45,614 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 05:12:45,719 WARN [BP-667286812-172.31.14.131-1689916193600 heartbeating to localhost/127.0.0.1:40289] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 05:12:45,719 WARN [BP-667286812-172.31.14.131-1689916193600 heartbeating to localhost/127.0.0.1:40289] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-667286812-172.31.14.131-1689916193600 (Datanode Uuid 40257d29-2b5e-42b9-a52f-17518c4eec96) service to localhost/127.0.0.1:40289 2023-07-21 05:12:45,721 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data5/current/BP-667286812-172.31.14.131-1689916193600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:45,721 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data6/current/BP-667286812-172.31.14.131-1689916193600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:45,723 WARN [Listener at jenkins-hbase4.apache.org/42887] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 05:12:45,727 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 05:12:45,831 WARN [BP-667286812-172.31.14.131-1689916193600 heartbeating to localhost/127.0.0.1:40289] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 05:12:45,831 WARN [BP-667286812-172.31.14.131-1689916193600 heartbeating to localhost/127.0.0.1:40289] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-667286812-172.31.14.131-1689916193600 (Datanode Uuid bf22acaf-65ad-4566-ab10-8eb2c2aab280) service to localhost/127.0.0.1:40289 2023-07-21 05:12:45,832 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data3/current/BP-667286812-172.31.14.131-1689916193600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:45,832 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data4/current/BP-667286812-172.31.14.131-1689916193600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:45,833 WARN [Listener at jenkins-hbase4.apache.org/42887] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-21 05:12:45,837 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 05:12:45,940 WARN [BP-667286812-172.31.14.131-1689916193600 heartbeating to localhost/127.0.0.1:40289] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-21 05:12:45,940 WARN [BP-667286812-172.31.14.131-1689916193600 heartbeating to localhost/127.0.0.1:40289] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-667286812-172.31.14.131-1689916193600 (Datanode Uuid dcc11696-10a7-4b0a-a4d1-8ac0131f6316) service to localhost/127.0.0.1:40289 2023-07-21 05:12:45,941 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data1/current/BP-667286812-172.31.14.131-1689916193600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:45,941 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9b0b4c4f-eb69-7f5e-4afd-a98cf0ddbb12/cluster_38da2bdf-935f-264e-dcb0-3232160c2e1e/dfs/data/data2/current/BP-667286812-172.31.14.131-1689916193600] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-21 05:12:45,964 INFO [Listener at jenkins-hbase4.apache.org/42887] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-21 05:12:46,095 INFO [Listener at jenkins-hbase4.apache.org/42887] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-21 05:12:46,190 INFO [Listener at jenkins-hbase4.apache.org/42887] hbase.HBaseTestingUtility(1293): Minicluster is down