2023-07-15 16:10:47,351 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-15 16:10:47,648 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8 2023-07-15 16:10:47,649 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-15 16:10:47,649 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-15 16:10:47,707 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-15 16:10:48,012 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-15 16:10:48,013 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271, deleteOnExit=true 2023-07-15 16:10:48,013 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-15 16:10:48,014 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/test.cache.data in system properties and HBase conf 2023-07-15 16:10:48,015 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 16:10:48,015 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop.log.dir in system properties and HBase conf 2023-07-15 16:10:48,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 16:10:48,016 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 16:10:48,016 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 16:10:48,466 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-15 16:10:48,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:10:48,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:10:48,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 16:10:48,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:10:48,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 16:10:48,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 16:10:48,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:10:48,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:10:48,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 16:10:48,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/nfs.dump.dir in system properties and HBase conf 2023-07-15 16:10:48,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir in system properties and HBase conf 2023-07-15 16:10:48,476 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:10:48,476 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 16:10:48,476 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-15 16:10:49,114 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 16:10:49,121 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 16:10:49,478 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-15 16:10:49,695 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-15 16:10:49,710 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:10:49,760 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:10:49,797 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir/Jetty_localhost_45581_hdfs____.76y9op/webapp 2023-07-15 16:10:49,942 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45581 2023-07-15 16:10:49,985 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-15 16:10:49,986 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-15 16:10:50,583 WARN [Listener at localhost/34451] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:10:50,688 WARN [Listener at localhost/34451] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 16:10:50,718 WARN [Listener at localhost/34451] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:10:50,727 INFO [Listener at localhost/34451] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:10:50,737 INFO [Listener at localhost/34451] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir/Jetty_localhost_42277_datanode____onkgmz/webapp 2023-07-15 16:10:50,875 INFO [Listener at localhost/34451] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42277 2023-07-15 16:10:51,385 WARN [Listener at localhost/33795] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:10:51,424 WARN [Listener at localhost/33795] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 16:10:51,430 WARN [Listener at localhost/33795] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:10:51,434 INFO [Listener at localhost/33795] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:10:51,441 INFO [Listener at localhost/33795] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir/Jetty_localhost_40963_datanode____uqs9ep/webapp 2023-07-15 16:10:51,578 INFO [Listener at localhost/33795] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40963 2023-07-15 16:10:51,642 WARN [Listener at localhost/36807] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:10:51,709 WARN [Listener at localhost/36807] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-15 16:10:51,718 WARN [Listener at localhost/36807] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:10:51,721 INFO [Listener at localhost/36807] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:10:51,734 INFO [Listener at localhost/36807] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir/Jetty_localhost_45811_datanode____f3s9lq/webapp 2023-07-15 16:10:51,915 INFO [Listener at localhost/36807] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45811 2023-07-15 16:10:51,969 WARN [Listener at localhost/38811] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-15 16:10:52,250 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc39348e893e47cf7: Processing first storage report for DS-c1ccf91a-d5e5-47ca-8126-836772e747f6 from datanode b760099e-9470-4da0-a8cc-2f7fc227eed7 2023-07-15 16:10:52,252 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc39348e893e47cf7: from storage DS-c1ccf91a-d5e5-47ca-8126-836772e747f6 node DatanodeRegistration(127.0.0.1:36189, datanodeUuid=b760099e-9470-4da0-a8cc-2f7fc227eed7, infoPort=43319, infoSecurePort=0, ipcPort=38811, storageInfo=lv=-57;cid=testClusterID;nsid=2124998189;c=1689437449218), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,252 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x504b132c6fec12ba: Processing first storage report for DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c from datanode ab3cd4eb-8cb3-4fb7-9b50-c07c724aac72 2023-07-15 16:10:52,252 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x504b132c6fec12ba: from storage DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c node DatanodeRegistration(127.0.0.1:39995, datanodeUuid=ab3cd4eb-8cb3-4fb7-9b50-c07c724aac72, infoPort=42863, infoSecurePort=0, ipcPort=33795, storageInfo=lv=-57;cid=testClusterID;nsid=2124998189;c=1689437449218), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,252 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x878b227bf9234c3b: Processing first storage report for DS-a685c812-27dd-42b0-b4aa-58e06c2919d9 from datanode 257ec7b5-4724-4a81-b9f3-eccedb98d2ee 2023-07-15 16:10:52,252 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x878b227bf9234c3b: from storage DS-a685c812-27dd-42b0-b4aa-58e06c2919d9 node DatanodeRegistration(127.0.0.1:41795, datanodeUuid=257ec7b5-4724-4a81-b9f3-eccedb98d2ee, infoPort=41949, infoSecurePort=0, ipcPort=36807, storageInfo=lv=-57;cid=testClusterID;nsid=2124998189;c=1689437449218), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,253 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc39348e893e47cf7: Processing first storage report for DS-00076d06-18e1-4372-b123-cd54172e6250 from datanode b760099e-9470-4da0-a8cc-2f7fc227eed7 2023-07-15 16:10:52,253 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc39348e893e47cf7: from storage DS-00076d06-18e1-4372-b123-cd54172e6250 node DatanodeRegistration(127.0.0.1:36189, datanodeUuid=b760099e-9470-4da0-a8cc-2f7fc227eed7, infoPort=43319, infoSecurePort=0, ipcPort=38811, storageInfo=lv=-57;cid=testClusterID;nsid=2124998189;c=1689437449218), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,253 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x504b132c6fec12ba: Processing first storage report for DS-da491dbf-ca9f-459e-b214-897408d7eb35 from datanode ab3cd4eb-8cb3-4fb7-9b50-c07c724aac72 2023-07-15 16:10:52,253 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x504b132c6fec12ba: from storage DS-da491dbf-ca9f-459e-b214-897408d7eb35 node DatanodeRegistration(127.0.0.1:39995, datanodeUuid=ab3cd4eb-8cb3-4fb7-9b50-c07c724aac72, infoPort=42863, infoSecurePort=0, ipcPort=33795, storageInfo=lv=-57;cid=testClusterID;nsid=2124998189;c=1689437449218), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,253 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x878b227bf9234c3b: Processing first storage report for DS-e224aa77-3b9c-4fc8-9efa-f64222cc2981 from datanode 257ec7b5-4724-4a81-b9f3-eccedb98d2ee 2023-07-15 16:10:52,253 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x878b227bf9234c3b: from storage DS-e224aa77-3b9c-4fc8-9efa-f64222cc2981 node DatanodeRegistration(127.0.0.1:41795, datanodeUuid=257ec7b5-4724-4a81-b9f3-eccedb98d2ee, infoPort=41949, infoSecurePort=0, ipcPort=36807, storageInfo=lv=-57;cid=testClusterID;nsid=2124998189;c=1689437449218), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-15 16:10:52,610 DEBUG [Listener at localhost/38811] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8 2023-07-15 16:10:52,728 INFO [Listener at localhost/38811] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/zookeeper_0, clientPort=62768, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-15 16:10:52,754 INFO [Listener at localhost/38811] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62768 2023-07-15 16:10:52,766 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:52,769 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:53,454 INFO [Listener at localhost/38811] util.FSUtils(471): Created version file at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 with version=8 2023-07-15 16:10:53,454 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/hbase-staging 2023-07-15 16:10:53,832 INFO [Listener at localhost/38811] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-15 16:10:54,377 INFO [Listener at localhost/38811] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 16:10:54,421 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,421 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,421 INFO [Listener at localhost/38811] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:10:54,421 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:54,422 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:10:54,588 INFO [Listener at localhost/38811] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:10:54,665 DEBUG [Listener at localhost/38811] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-15 16:10:54,781 INFO [Listener at localhost/38811] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38191 2023-07-15 16:10:54,796 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:54,798 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:54,832 INFO [Listener at localhost/38811] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38191 connecting to ZooKeeper ensemble=127.0.0.1:62768 2023-07-15 16:10:54,903 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:381910x0, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:10:54,907 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38191-0x10169c03c9a0000 connected 2023-07-15 16:10:54,958 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:10:54,959 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:10:54,977 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:10:54,990 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38191 2023-07-15 16:10:54,990 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38191 2023-07-15 16:10:54,991 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38191 2023-07-15 16:10:54,992 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38191 2023-07-15 16:10:54,993 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38191 2023-07-15 16:10:55,002 INFO [Listener at localhost/38811] master.HMaster(444): hbase.rootdir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9, hbase.cluster.distributed=false 2023-07-15 16:10:55,091 INFO [Listener at localhost/38811] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 16:10:55,092 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,092 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,092 INFO [Listener at localhost/38811] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:10:55,092 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,093 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:10:55,100 INFO [Listener at localhost/38811] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:10:55,106 INFO [Listener at localhost/38811] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43477 2023-07-15 16:10:55,110 INFO [Listener at localhost/38811] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 16:10:55,120 INFO [Listener at localhost/38811] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 16:10:55,122 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,124 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,127 INFO [Listener at localhost/38811] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43477 connecting to ZooKeeper ensemble=127.0.0.1:62768 2023-07-15 16:10:55,142 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:434770x0, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:10:55,143 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): regionserver:434770x0, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:10:55,156 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): regionserver:434770x0, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:10:55,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43477-0x10169c03c9a0001 connected 2023-07-15 16:10:55,158 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:10:55,165 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43477 2023-07-15 16:10:55,166 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43477 2023-07-15 16:10:55,172 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43477 2023-07-15 16:10:55,174 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43477 2023-07-15 16:10:55,178 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43477 2023-07-15 16:10:55,211 INFO [Listener at localhost/38811] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 16:10:55,211 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,211 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,212 INFO [Listener at localhost/38811] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:10:55,212 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,212 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:10:55,213 INFO [Listener at localhost/38811] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:10:55,214 INFO [Listener at localhost/38811] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46287 2023-07-15 16:10:55,215 INFO [Listener at localhost/38811] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 16:10:55,218 INFO [Listener at localhost/38811] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 16:10:55,220 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,229 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,231 INFO [Listener at localhost/38811] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46287 connecting to ZooKeeper ensemble=127.0.0.1:62768 2023-07-15 16:10:55,238 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:462870x0, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:10:55,239 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): regionserver:462870x0, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:10:55,240 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): regionserver:462870x0, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:10:55,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46287-0x10169c03c9a0002 connected 2023-07-15 16:10:55,245 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:10:55,250 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46287 2023-07-15 16:10:55,251 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46287 2023-07-15 16:10:55,251 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46287 2023-07-15 16:10:55,252 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46287 2023-07-15 16:10:55,254 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46287 2023-07-15 16:10:55,270 INFO [Listener at localhost/38811] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-15 16:10:55,270 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,271 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,271 INFO [Listener at localhost/38811] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-15 16:10:55,271 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-15 16:10:55,271 INFO [Listener at localhost/38811] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-15 16:10:55,271 INFO [Listener at localhost/38811] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-15 16:10:55,273 INFO [Listener at localhost/38811] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33799 2023-07-15 16:10:55,273 INFO [Listener at localhost/38811] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-15 16:10:55,275 INFO [Listener at localhost/38811] mob.MobFileCache(124): MobFileCache disabled 2023-07-15 16:10:55,277 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,278 INFO [Listener at localhost/38811] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,279 INFO [Listener at localhost/38811] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33799 connecting to ZooKeeper ensemble=127.0.0.1:62768 2023-07-15 16:10:55,287 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:337990x0, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-15 16:10:55,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33799-0x10169c03c9a0003 connected 2023-07-15 16:10:55,288 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:10:55,289 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:10:55,289 DEBUG [Listener at localhost/38811] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-15 16:10:55,291 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33799 2023-07-15 16:10:55,291 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33799 2023-07-15 16:10:55,294 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33799 2023-07-15 16:10:55,297 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33799 2023-07-15 16:10:55,297 DEBUG [Listener at localhost/38811] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33799 2023-07-15 16:10:55,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:10:55,309 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 16:10:55,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:10:55,334 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:10:55,334 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:10:55,335 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:10:55,334 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-15 16:10:55,335 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:55,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 16:10:55,349 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-15 16:10:55,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38191,1689437453645 from backup master directory 2023-07-15 16:10:55,355 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:10:55,355 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-15 16:10:55,359 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:10:55,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:10:55,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-15 16:10:55,364 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-15 16:10:55,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/hbase.id with ID: e2a68240-1965-459b-adeb-83e0fb14d87d 2023-07-15 16:10:55,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-15 16:10:55,558 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:55,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x013ed4f9 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:55,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44cf3185, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:55,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:10:55,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-15 16:10:55,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-15 16:10:55,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-15 16:10:55,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 16:10:55,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-15 16:10:55,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:55,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/data/master/store-tmp 2023-07-15 16:10:55,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:55,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 16:10:55,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:10:55,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:10:55,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 16:10:55,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:10:55,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:10:55,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 16:10:55,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/WALs/jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:10:55,892 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38191%2C1689437453645, suffix=, logDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/WALs/jenkins-hbase4.apache.org,38191,1689437453645, archiveDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/oldWALs, maxLogs=10 2023-07-15 16:10:55,976 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK] 2023-07-15 16:10:55,976 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK] 2023-07-15 16:10:55,976 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK] 2023-07-15 16:10:55,987 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-15 16:10:56,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/WALs/jenkins-hbase4.apache.org,38191,1689437453645/jenkins-hbase4.apache.org%2C38191%2C1689437453645.1689437455911 2023-07-15 16:10:56,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK], DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK], DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK]] 2023-07-15 16:10:56,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:10:56,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:56,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,097 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,192 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,201 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-15 16:10:56,240 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-15 16:10:56,256 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:56,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,287 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-15 16:10:56,292 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:10:56,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64079984, jitterRate=-0.04513382911682129}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:10:56,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 16:10:56,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-15 16:10:56,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-15 16:10:56,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-15 16:10:56,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-15 16:10:56,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-15 16:10:56,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 47 msec 2023-07-15 16:10:56,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-15 16:10:56,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-15 16:10:56,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-15 16:10:56,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-15 16:10:56,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-15 16:10:56,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-15 16:10:56,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-15 16:10:56,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-15 16:10:56,485 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:56,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-15 16:10:56,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-15 16:10:56,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-15 16:10:56,508 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:10:56,508 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:10:56,508 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:10:56,508 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-15 16:10:56,508 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:56,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,38191,1689437453645, sessionid=0x10169c03c9a0000, setting cluster-up flag (Was=false) 2023-07-15 16:10:56,527 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:56,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-15 16:10:56,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:10:56,546 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:56,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-15 16:10:56,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:10:56,564 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp 2023-07-15 16:10:56,604 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(951): ClusterId : e2a68240-1965-459b-adeb-83e0fb14d87d 2023-07-15 16:10:56,614 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(951): ClusterId : e2a68240-1965-459b-adeb-83e0fb14d87d 2023-07-15 16:10:56,617 INFO [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(951): ClusterId : e2a68240-1965-459b-adeb-83e0fb14d87d 2023-07-15 16:10:56,624 DEBUG [RS:1;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 16:10:56,626 DEBUG [RS:2;jenkins-hbase4:33799] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 16:10:56,626 DEBUG [RS:0;jenkins-hbase4:43477] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-15 16:10:56,635 DEBUG [RS:2;jenkins-hbase4:33799] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 16:10:56,635 DEBUG [RS:0;jenkins-hbase4:43477] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 16:10:56,635 DEBUG [RS:1;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-15 16:10:56,635 DEBUG [RS:1;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 16:10:56,635 DEBUG [RS:2;jenkins-hbase4:33799] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 16:10:56,635 DEBUG [RS:0;jenkins-hbase4:43477] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-15 16:10:56,643 DEBUG [RS:0;jenkins-hbase4:43477] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 16:10:56,644 DEBUG [RS:1;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 16:10:56,648 DEBUG [RS:2;jenkins-hbase4:33799] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-15 16:10:56,648 DEBUG [RS:1;jenkins-hbase4:46287] zookeeper.ReadOnlyZKClient(139): Connect 0x4c967409 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:56,649 DEBUG [RS:0;jenkins-hbase4:43477] zookeeper.ReadOnlyZKClient(139): Connect 0x0b405130 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:56,667 DEBUG [RS:2;jenkins-hbase4:33799] zookeeper.ReadOnlyZKClient(139): Connect 0x404d3043 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:56,680 DEBUG [RS:0;jenkins-hbase4:43477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@587ae28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:56,683 DEBUG [RS:1;jenkins-hbase4:46287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425193eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:56,683 DEBUG [RS:0;jenkins-hbase4:43477] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b83a40, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:10:56,683 DEBUG [RS:1;jenkins-hbase4:46287] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@466e1f79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:10:56,719 DEBUG [RS:2;jenkins-hbase4:33799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e8ad63a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:56,719 DEBUG [RS:2;jenkins-hbase4:33799] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ab55b33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:10:56,742 DEBUG [RS:2;jenkins-hbase4:33799] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:33799 2023-07-15 16:10:56,743 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43477 2023-07-15 16:10:56,746 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46287 2023-07-15 16:10:56,752 INFO [RS:2;jenkins-hbase4:33799] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 16:10:56,752 INFO [RS:0;jenkins-hbase4:43477] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 16:10:56,753 INFO [RS:2;jenkins-hbase4:33799] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 16:10:56,752 INFO [RS:1;jenkins-hbase4:46287] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-15 16:10:56,753 INFO [RS:1;jenkins-hbase4:46287] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 16:10:56,753 INFO [RS:0;jenkins-hbase4:43477] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-15 16:10:56,755 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-15 16:10:56,758 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 16:10:56,758 DEBUG [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 16:10:56,758 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-15 16:10:56,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:56,760 INFO [RS:0;jenkins-hbase4:43477] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:56,760 INFO [RS:2;jenkins-hbase4:33799] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:56,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-15 16:10:56,760 INFO [RS:1;jenkins-hbase4:46287] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:56,760 DEBUG [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 16:10:56,760 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 16:10:56,760 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1022): About to register with Master. 2023-07-15 16:10:56,765 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38191,1689437453645 with isa=jenkins-hbase4.apache.org/172.31.14.131:43477, startcode=1689437455090 2023-07-15 16:10:56,765 INFO [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38191,1689437453645 with isa=jenkins-hbase4.apache.org/172.31.14.131:33799, startcode=1689437455269 2023-07-15 16:10:56,765 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38191,1689437453645 with isa=jenkins-hbase4.apache.org/172.31.14.131:46287, startcode=1689437455210 2023-07-15 16:10:56,788 DEBUG [RS:1;jenkins-hbase4:46287] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 16:10:56,791 DEBUG [RS:0;jenkins-hbase4:43477] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 16:10:56,789 DEBUG [RS:2;jenkins-hbase4:33799] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-15 16:10:56,868 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58847, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 16:10:56,868 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53297, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 16:10:56,869 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59593, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-15 16:10:56,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-15 16:10:56,881 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38191] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 16:10:56,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:10:56,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:10:56,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:10:56,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-15 16:10:56,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-15 16:10:56,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:56,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:10:56,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:56,892 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38191] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 16:10:56,892 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38191] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-15 16:10:56,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689437486896 2023-07-15 16:10:56,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-15 16:10:56,906 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 16:10:56,907 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-15 16:10:56,913 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 16:10:56,923 DEBUG [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 16:10:56,923 WARN [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 16:10:56,926 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 16:10:56,926 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(2830): Master is not running yet 2023-07-15 16:10:56,926 WARN [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 16:10:56,926 WARN [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-15 16:10:56,927 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-15 16:10:56,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-15 16:10:56,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-15 16:10:56,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-15 16:10:56,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-15 16:10:56,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:56,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-15 16:10:56,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-15 16:10:56,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-15 16:10:56,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-15 16:10:56,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-15 16:10:56,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689437456947,5,FailOnTimeoutGroup] 2023-07-15 16:10:56,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689437456948,5,FailOnTimeoutGroup] 2023-07-15 16:10:56,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:56,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-15 16:10:56,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:56,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,022 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 16:10:57,024 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-15 16:10:57,024 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:10:57,025 INFO [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38191,1689437453645 with isa=jenkins-hbase4.apache.org/172.31.14.131:33799, startcode=1689437455269 2023-07-15 16:10:57,028 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38191,1689437453645 with isa=jenkins-hbase4.apache.org/172.31.14.131:46287, startcode=1689437455210 2023-07-15 16:10:57,028 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,38191,1689437453645 with isa=jenkins-hbase4.apache.org/172.31.14.131:43477, startcode=1689437455090 2023-07-15 16:10:57,033 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38191] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:10:57,040 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38191] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:57,041 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38191] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:57,046 DEBUG [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:10:57,046 DEBUG [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34451 2023-07-15 16:10:57,046 DEBUG [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 16:10:57,046 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:10:57,046 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34451 2023-07-15 16:10:57,047 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 16:10:57,047 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:10:57,047 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34451 2023-07-15 16:10:57,047 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-15 16:10:57,062 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:10:57,067 DEBUG [RS:2;jenkins-hbase4:33799] zookeeper.ZKUtil(162): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:10:57,067 DEBUG [RS:0;jenkins-hbase4:43477] zookeeper.ZKUtil(162): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:57,067 WARN [RS:2;jenkins-hbase4:33799] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:10:57,067 WARN [RS:0;jenkins-hbase4:43477] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:10:57,068 DEBUG [RS:1;jenkins-hbase4:46287] zookeeper.ZKUtil(162): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:57,068 INFO [RS:2;jenkins-hbase4:33799] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:57,068 WARN [RS:1;jenkins-hbase4:46287] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-15 16:10:57,068 DEBUG [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:10:57,070 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46287,1689437455210] 2023-07-15 16:10:57,070 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43477,1689437455090] 2023-07-15 16:10:57,070 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33799,1689437455269] 2023-07-15 16:10:57,068 INFO [RS:1;jenkins-hbase4:46287] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:57,068 INFO [RS:0;jenkins-hbase4:43477] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:57,071 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:57,072 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:57,075 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:57,088 DEBUG [RS:0;jenkins-hbase4:43477] zookeeper.ZKUtil(162): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:57,089 DEBUG [RS:0;jenkins-hbase4:43477] zookeeper.ZKUtil(162): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:57,091 DEBUG [RS:0;jenkins-hbase4:43477] zookeeper.ZKUtil(162): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:10:57,096 DEBUG [RS:2;jenkins-hbase4:33799] zookeeper.ZKUtil(162): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:57,097 DEBUG [RS:1;jenkins-hbase4:46287] zookeeper.ZKUtil(162): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:57,097 DEBUG [RS:2;jenkins-hbase4:33799] zookeeper.ZKUtil(162): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:57,098 DEBUG [RS:1;jenkins-hbase4:46287] zookeeper.ZKUtil(162): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:57,098 DEBUG [RS:2;jenkins-hbase4:33799] zookeeper.ZKUtil(162): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:10:57,099 DEBUG [RS:1;jenkins-hbase4:46287] zookeeper.ZKUtil(162): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:10:57,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 16:10:57,112 DEBUG [RS:2;jenkins-hbase4:33799] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 16:10:57,113 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/info 2023-07-15 16:10:57,114 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 16:10:57,115 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 16:10:57,115 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-15 16:10:57,121 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:57,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 16:10:57,125 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/rep_barrier 2023-07-15 16:10:57,126 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 16:10:57,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:57,127 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 16:10:57,130 INFO [RS:1;jenkins-hbase4:46287] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 16:10:57,130 INFO [RS:0;jenkins-hbase4:43477] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 16:10:57,131 INFO [RS:2;jenkins-hbase4:33799] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-15 16:10:57,136 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/table 2023-07-15 16:10:57,137 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 16:10:57,146 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:57,157 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740 2023-07-15 16:10:57,159 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740 2023-07-15 16:10:57,167 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 16:10:57,175 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 16:10:57,191 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:10:57,192 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69726537, jitterRate=0.039006367325782776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 16:10:57,192 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 16:10:57,192 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 16:10:57,192 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 16:10:57,192 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 16:10:57,192 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 16:10:57,192 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 16:10:57,195 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 16:10:57,197 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 16:10:57,199 INFO [RS:2;jenkins-hbase4:33799] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 16:10:57,200 INFO [RS:0;jenkins-hbase4:43477] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 16:10:57,200 INFO [RS:1;jenkins-hbase4:46287] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-15 16:10:57,205 INFO [RS:0;jenkins-hbase4:43477] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 16:10:57,211 INFO [RS:2;jenkins-hbase4:33799] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 16:10:57,211 INFO [RS:2;jenkins-hbase4:33799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,214 INFO [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 16:10:57,214 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-15 16:10:57,214 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-15 16:10:57,205 INFO [RS:0;jenkins-hbase4:43477] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,207 INFO [RS:1;jenkins-hbase4:46287] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-15 16:10:57,216 INFO [RS:1;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,216 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 16:10:57,217 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-15 16:10:57,229 INFO [RS:0;jenkins-hbase4:43477] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,229 INFO [RS:2;jenkins-hbase4:33799] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,229 INFO [RS:1;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,229 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,230 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,230 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,230 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,230 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,230 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,230 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,230 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,230 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,230 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:10:57,231 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:10:57,230 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:0;jenkins-hbase4:43477] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:1;jenkins-hbase4:46287] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,231 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,232 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,232 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,232 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-15 16:10:57,232 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,232 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,232 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,232 DEBUG [RS:2;jenkins-hbase4:33799] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-15 16:10:57,234 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-15 16:10:57,243 INFO [RS:2;jenkins-hbase4:33799] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,243 INFO [RS:2;jenkins-hbase4:33799] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,243 INFO [RS:2;jenkins-hbase4:33799] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,247 INFO [RS:1;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,250 INFO [RS:0;jenkins-hbase4:43477] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,250 INFO [RS:0;jenkins-hbase4:43477] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,250 INFO [RS:0;jenkins-hbase4:43477] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,250 INFO [RS:1;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,251 INFO [RS:1;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,262 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-15 16:10:57,265 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-15 16:10:57,273 INFO [RS:0;jenkins-hbase4:43477] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 16:10:57,273 INFO [RS:2;jenkins-hbase4:33799] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 16:10:57,275 INFO [RS:1;jenkins-hbase4:46287] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-15 16:10:57,277 INFO [RS:1;jenkins-hbase4:46287] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46287,1689437455210-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,277 INFO [RS:0;jenkins-hbase4:43477] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43477,1689437455090-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,277 INFO [RS:2;jenkins-hbase4:33799] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33799,1689437455269-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:57,300 INFO [RS:0;jenkins-hbase4:43477] regionserver.Replication(203): jenkins-hbase4.apache.org,43477,1689437455090 started 2023-07-15 16:10:57,300 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43477,1689437455090, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43477, sessionid=0x10169c03c9a0001 2023-07-15 16:10:57,302 INFO [RS:2;jenkins-hbase4:33799] regionserver.Replication(203): jenkins-hbase4.apache.org,33799,1689437455269 started 2023-07-15 16:10:57,302 INFO [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33799,1689437455269, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33799, sessionid=0x10169c03c9a0003 2023-07-15 16:10:57,302 INFO [RS:1;jenkins-hbase4:46287] regionserver.Replication(203): jenkins-hbase4.apache.org,46287,1689437455210 started 2023-07-15 16:10:57,302 DEBUG [RS:2;jenkins-hbase4:33799] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 16:10:57,302 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46287,1689437455210, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46287, sessionid=0x10169c03c9a0002 2023-07-15 16:10:57,303 DEBUG [RS:1;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 16:10:57,303 DEBUG [RS:2;jenkins-hbase4:33799] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:10:57,303 DEBUG [RS:1;jenkins-hbase4:46287] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:57,303 DEBUG [RS:0;jenkins-hbase4:43477] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-15 16:10:57,304 DEBUG [RS:1;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46287,1689437455210' 2023-07-15 16:10:57,304 DEBUG [RS:2;jenkins-hbase4:33799] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33799,1689437455269' 2023-07-15 16:10:57,307 DEBUG [RS:1;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:10:57,307 DEBUG [RS:2;jenkins-hbase4:33799] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:10:57,306 DEBUG [RS:0;jenkins-hbase4:43477] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:57,309 DEBUG [RS:0;jenkins-hbase4:43477] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43477,1689437455090' 2023-07-15 16:10:57,309 DEBUG [RS:0;jenkins-hbase4:43477] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-15 16:10:57,310 DEBUG [RS:2;jenkins-hbase4:33799] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:10:57,310 DEBUG [RS:0;jenkins-hbase4:43477] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:10:57,311 DEBUG [RS:2;jenkins-hbase4:33799] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 16:10:57,311 DEBUG [RS:2;jenkins-hbase4:33799] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 16:10:57,311 DEBUG [RS:2;jenkins-hbase4:33799] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:10:57,311 DEBUG [RS:2;jenkins-hbase4:33799] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33799,1689437455269' 2023-07-15 16:10:57,311 DEBUG [RS:2;jenkins-hbase4:33799] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:10:57,311 DEBUG [RS:0;jenkins-hbase4:43477] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 16:10:57,311 DEBUG [RS:0;jenkins-hbase4:43477] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 16:10:57,311 DEBUG [RS:0;jenkins-hbase4:43477] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:57,315 DEBUG [RS:0;jenkins-hbase4:43477] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43477,1689437455090' 2023-07-15 16:10:57,315 DEBUG [RS:0;jenkins-hbase4:43477] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:10:57,315 DEBUG [RS:2;jenkins-hbase4:33799] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:10:57,316 DEBUG [RS:0;jenkins-hbase4:43477] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:10:57,316 DEBUG [RS:2;jenkins-hbase4:33799] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 16:10:57,316 INFO [RS:2;jenkins-hbase4:33799] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 16:10:57,316 INFO [RS:2;jenkins-hbase4:33799] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 16:10:57,317 DEBUG [RS:0;jenkins-hbase4:43477] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 16:10:57,317 INFO [RS:0;jenkins-hbase4:43477] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 16:10:57,318 INFO [RS:0;jenkins-hbase4:43477] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 16:10:57,311 DEBUG [RS:1;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-15 16:10:57,319 DEBUG [RS:1;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-15 16:10:57,319 DEBUG [RS:1;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-15 16:10:57,319 DEBUG [RS:1;jenkins-hbase4:46287] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:57,319 DEBUG [RS:1;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46287,1689437455210' 2023-07-15 16:10:57,319 DEBUG [RS:1;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:10:57,320 DEBUG [RS:1;jenkins-hbase4:46287] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:10:57,320 DEBUG [RS:1;jenkins-hbase4:46287] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-15 16:10:57,320 INFO [RS:1;jenkins-hbase4:46287] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-15 16:10:57,321 INFO [RS:1;jenkins-hbase4:46287] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-15 16:10:57,417 DEBUG [jenkins-hbase4:38191] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-15 16:10:57,423 DEBUG [jenkins-hbase4:38191] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:10:57,431 INFO [RS:2;jenkins-hbase4:33799] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33799%2C1689437455269, suffix=, logDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,33799,1689437455269, archiveDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/oldWALs, maxLogs=32 2023-07-15 16:10:57,431 INFO [RS:1;jenkins-hbase4:46287] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46287%2C1689437455210, suffix=, logDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,46287,1689437455210, archiveDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/oldWALs, maxLogs=32 2023-07-15 16:10:57,433 INFO [RS:0;jenkins-hbase4:43477] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43477%2C1689437455090, suffix=, logDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,43477,1689437455090, archiveDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/oldWALs, maxLogs=32 2023-07-15 16:10:57,446 DEBUG [jenkins-hbase4:38191] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:10:57,446 DEBUG [jenkins-hbase4:38191] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:10:57,446 DEBUG [jenkins-hbase4:38191] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:10:57,446 DEBUG [jenkins-hbase4:38191] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:10:57,450 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46287,1689437455210, state=OPENING 2023-07-15 16:10:57,460 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-15 16:10:57,461 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:57,462 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 16:10:57,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:10:57,482 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK] 2023-07-15 16:10:57,482 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK] 2023-07-15 16:10:57,482 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK] 2023-07-15 16:10:57,491 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK] 2023-07-15 16:10:57,493 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK] 2023-07-15 16:10:57,495 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK] 2023-07-15 16:10:57,511 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK] 2023-07-15 16:10:57,512 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK] 2023-07-15 16:10:57,514 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK] 2023-07-15 16:10:57,532 INFO [RS:1;jenkins-hbase4:46287] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,46287,1689437455210/jenkins-hbase4.apache.org%2C46287%2C1689437455210.1689437457439 2023-07-15 16:10:57,545 DEBUG [RS:1;jenkins-hbase4:46287] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK], DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK], DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK]] 2023-07-15 16:10:57,552 INFO [RS:2;jenkins-hbase4:33799] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,33799,1689437455269/jenkins-hbase4.apache.org%2C33799%2C1689437455269.1689437457440 2023-07-15 16:10:57,552 INFO [RS:0;jenkins-hbase4:43477] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,43477,1689437455090/jenkins-hbase4.apache.org%2C43477%2C1689437455090.1689437457439 2023-07-15 16:10:57,557 DEBUG [RS:2;jenkins-hbase4:33799] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK], DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK], DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK]] 2023-07-15 16:10:57,582 DEBUG [RS:0;jenkins-hbase4:43477] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK], DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK], DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK]] 2023-07-15 16:10:57,738 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:57,740 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:10:57,745 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:10:57,761 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-15 16:10:57,762 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-15 16:10:57,766 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46287%2C1689437455210.meta, suffix=.meta, logDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,46287,1689437455210, archiveDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/oldWALs, maxLogs=32 2023-07-15 16:10:57,794 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK] 2023-07-15 16:10:57,803 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK] 2023-07-15 16:10:57,803 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK] 2023-07-15 16:10:57,827 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,46287,1689437455210/jenkins-hbase4.apache.org%2C46287%2C1689437455210.meta.1689437457767.meta 2023-07-15 16:10:57,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36189,DS-c1ccf91a-d5e5-47ca-8126-836772e747f6,DISK], DatanodeInfoWithStorage[127.0.0.1:41795,DS-a685c812-27dd-42b0-b4aa-58e06c2919d9,DISK], DatanodeInfoWithStorage[127.0.0.1:39995,DS-f163bff4-0628-4df4-94f3-2a89d3e99d2c,DISK]] 2023-07-15 16:10:57,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:10:57,830 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-15 16:10:57,832 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:57,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-15 16:10:57,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-15 16:10:57,838 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-15 16:10:57,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-15 16:10:57,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:57,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-15 16:10:57,860 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-15 16:10:57,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-15 16:10:57,867 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/info 2023-07-15 16:10:57,867 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/info 2023-07-15 16:10:57,868 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-15 16:10:57,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:57,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-15 16:10:57,872 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/rep_barrier 2023-07-15 16:10:57,872 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/rep_barrier 2023-07-15 16:10:57,872 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-15 16:10:57,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:57,873 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-15 16:10:57,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/table 2023-07-15 16:10:57,875 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/table 2023-07-15 16:10:57,876 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-15 16:10:57,877 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:57,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740 2023-07-15 16:10:57,884 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740 2023-07-15 16:10:57,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-15 16:10:57,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-15 16:10:57,903 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62534411, jitterRate=-0.06816466152667999}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-15 16:10:57,907 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-15 16:10:57,924 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689437457729 2023-07-15 16:10:57,963 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-15 16:10:57,965 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-15 16:10:57,966 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46287,1689437455210, state=OPEN 2023-07-15 16:10:57,970 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-15 16:10:57,970 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-15 16:10:57,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-15 16:10:57,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46287,1689437455210 in 497 msec 2023-07-15 16:10:57,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-15 16:10:57,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 745 msec 2023-07-15 16:10:58,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2350 sec 2023-07-15 16:10:58,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689437458007, completionTime=-1 2023-07-15 16:10:58,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-15 16:10:58,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-15 16:10:58,162 DEBUG [hconnection-0x4be88134-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:10:58,175 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:10:58,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-15 16:10:58,205 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689437518205 2023-07-15 16:10:58,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689437578206 2023-07-15 16:10:58,206 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 198 msec 2023-07-15 16:10:58,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38191,1689437453645-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:58,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38191,1689437453645-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:58,231 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38191,1689437453645-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:58,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38191, period=300000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:58,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-15 16:10:58,241 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-15 16:10:58,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-15 16:10:58,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 16:10:58,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-15 16:10:58,265 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:10:58,268 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:10:58,295 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/hbase/namespace/50dbda6487f689a4a76d795e09780628 2023-07-15 16:10:58,299 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/hbase/namespace/50dbda6487f689a4a76d795e09780628 empty. 2023-07-15 16:10:58,300 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/hbase/namespace/50dbda6487f689a4a76d795e09780628 2023-07-15 16:10:58,301 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-15 16:10:58,356 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-15 16:10:58,358 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 50dbda6487f689a4a76d795e09780628, NAME => 'hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:10:58,387 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:58,388 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 50dbda6487f689a4a76d795e09780628, disabling compactions & flushes 2023-07-15 16:10:58,388 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:10:58,388 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:10:58,388 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. after waiting 0 ms 2023-07-15 16:10:58,388 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:10:58,388 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:10:58,388 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 50dbda6487f689a4a76d795e09780628: 2023-07-15 16:10:58,399 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:10:58,417 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689437458402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437458402"}]},"ts":"1689437458402"} 2023-07-15 16:10:58,447 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 16:10:58,449 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:10:58,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437458449"}]},"ts":"1689437458449"} 2023-07-15 16:10:58,459 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-15 16:10:58,464 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:10:58,465 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:10:58,466 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:10:58,466 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:10:58,466 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:10:58,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=50dbda6487f689a4a76d795e09780628, ASSIGN}] 2023-07-15 16:10:58,472 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=50dbda6487f689a4a76d795e09780628, ASSIGN 2023-07-15 16:10:58,475 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=50dbda6487f689a4a76d795e09780628, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1689437455210; forceNewPlan=false, retain=false 2023-07-15 16:10:58,627 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 16:10:58,628 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=50dbda6487f689a4a76d795e09780628, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:58,629 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689437458628"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437458628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437458628"}]},"ts":"1689437458628"} 2023-07-15 16:10:58,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 50dbda6487f689a4a76d795e09780628, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:10:58,793 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:10:58,793 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50dbda6487f689a4a76d795e09780628, NAME => 'hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:10:58,794 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. service=AccessControlService 2023-07-15 16:10:58,795 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:58,795 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 50dbda6487f689a4a76d795e09780628 2023-07-15 16:10:58,796 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:58,796 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 50dbda6487f689a4a76d795e09780628 2023-07-15 16:10:58,796 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 50dbda6487f689a4a76d795e09780628 2023-07-15 16:10:58,799 INFO [StoreOpener-50dbda6487f689a4a76d795e09780628-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 50dbda6487f689a4a76d795e09780628 2023-07-15 16:10:58,801 DEBUG [StoreOpener-50dbda6487f689a4a76d795e09780628-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628/info 2023-07-15 16:10:58,801 DEBUG [StoreOpener-50dbda6487f689a4a76d795e09780628-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628/info 2023-07-15 16:10:58,802 INFO [StoreOpener-50dbda6487f689a4a76d795e09780628-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50dbda6487f689a4a76d795e09780628 columnFamilyName info 2023-07-15 16:10:58,803 INFO [StoreOpener-50dbda6487f689a4a76d795e09780628-1] regionserver.HStore(310): Store=50dbda6487f689a4a76d795e09780628/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:58,804 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628 2023-07-15 16:10:58,806 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628 2023-07-15 16:10:58,811 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 50dbda6487f689a4a76d795e09780628 2023-07-15 16:10:58,815 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:10:58,816 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 50dbda6487f689a4a76d795e09780628; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62437001, jitterRate=-0.06961618363857269}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:10:58,816 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 50dbda6487f689a4a76d795e09780628: 2023-07-15 16:10:58,819 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628., pid=6, masterSystemTime=1689437458786 2023-07-15 16:10:58,822 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:10:58,823 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:10:58,824 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=50dbda6487f689a4a76d795e09780628, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:10:58,824 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689437458824"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437458824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437458824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437458824"}]},"ts":"1689437458824"} 2023-07-15 16:10:58,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-15 16:10:58,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 50dbda6487f689a4a76d795e09780628, server=jenkins-hbase4.apache.org,46287,1689437455210 in 196 msec 2023-07-15 16:10:58,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-15 16:10:58,836 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=50dbda6487f689a4a76d795e09780628, ASSIGN in 363 msec 2023-07-15 16:10:58,837 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:10:58,837 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437458837"}]},"ts":"1689437458837"} 2023-07-15 16:10:58,840 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-15 16:10:58,844 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:10:58,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 593 msec 2023-07-15 16:10:58,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-15 16:10:58,865 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-15 16:10:58,865 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:10:58,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-15 16:10:58,925 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 16:10:58,932 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-07-15 16:10:58,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-15 16:10:58,955 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-15 16:10:58,960 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-15 16:10:58,968 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-15 16:10:58,972 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-15 16:10:58,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.615sec 2023-07-15 16:10:58,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-15 16:10:58,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-15 16:10:58,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-15 16:10:58,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38191,1689437453645-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-15 16:10:58,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38191,1689437453645-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-15 16:10:59,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-15 16:10:59,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-15 16:10:59,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:10:59,014 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:10:59,017 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:10:59,018 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9 empty. 2023-07-15 16:10:59,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-15 16:10:59,021 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:10:59,021 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-15 16:10:59,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 16:10:59,045 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-15 16:10:59,047 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 063b00081de8ec727d095e21e3cb33f9, NAME => 'hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:10:59,076 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:59,077 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 063b00081de8ec727d095e21e3cb33f9, disabling compactions & flushes 2023-07-15 16:10:59,077 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:10:59,077 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:10:59,077 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. after waiting 0 ms 2023-07-15 16:10:59,077 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:10:59,077 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:10:59,077 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 063b00081de8ec727d095e21e3cb33f9: 2023-07-15 16:10:59,079 DEBUG [Listener at localhost/38811] zookeeper.ReadOnlyZKClient(139): Connect 0x2645710c to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:10:59,083 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:10:59,086 DEBUG [Listener at localhost/38811] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39a9e5ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:10:59,086 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689437459086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437459086"}]},"ts":"1689437459086"} 2023-07-15 16:10:59,091 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-15 16:10:59,093 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:10:59,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437459094"}]},"ts":"1689437459094"} 2023-07-15 16:10:59,096 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-15 16:10:59,102 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:10:59,103 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:10:59,103 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:10:59,103 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:10:59,103 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:10:59,103 DEBUG [hconnection-0xebd2f59-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:10:59,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=063b00081de8ec727d095e21e3cb33f9, ASSIGN}] 2023-07-15 16:10:59,106 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=063b00081de8ec727d095e21e3cb33f9, ASSIGN 2023-07-15 16:10:59,108 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=063b00081de8ec727d095e21e3cb33f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43477,1689437455090; forceNewPlan=false, retain=false 2023-07-15 16:10:59,116 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:10:59,118 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:10:59,118 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-15 16:10:59,118 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/test.cache.data in system properties and HBase conf 2023-07-15 16:10:59,119 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop.tmp.dir in system properties and HBase conf 2023-07-15 16:10:59,119 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop.log.dir in system properties and HBase conf 2023-07-15 16:10:59,119 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-15 16:10:59,119 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-15 16:10:59,119 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-15 16:10:59,119 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:10:59,119 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-15 16:10:59,119 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-15 16:10:59,119 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/nfs.dump.dir in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-15 16:10:59,120 INFO [Listener at localhost/38811] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-15 16:10:59,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 16:10:59,259 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 16:10:59,260 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=063b00081de8ec727d095e21e3cb33f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:59,260 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689437459260"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437459260"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437459260"}]},"ts":"1689437459260"} 2023-07-15 16:10:59,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 063b00081de8ec727d095e21e3cb33f9, server=jenkins-hbase4.apache.org,43477,1689437455090}] 2023-07-15 16:10:59,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 16:10:59,420 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:59,421 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:10:59,424 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:10:59,432 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:10:59,433 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 063b00081de8ec727d095e21e3cb33f9, NAME => 'hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:10:59,433 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. service=AccessControlService 2023-07-15 16:10:59,434 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:10:59,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:10:59,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:10:59,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:10:59,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:10:59,437 INFO [StoreOpener-063b00081de8ec727d095e21e3cb33f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:10:59,439 DEBUG [StoreOpener-063b00081de8ec727d095e21e3cb33f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9/l 2023-07-15 16:10:59,439 DEBUG [StoreOpener-063b00081de8ec727d095e21e3cb33f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9/l 2023-07-15 16:10:59,440 INFO [StoreOpener-063b00081de8ec727d095e21e3cb33f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 063b00081de8ec727d095e21e3cb33f9 columnFamilyName l 2023-07-15 16:10:59,441 INFO [StoreOpener-063b00081de8ec727d095e21e3cb33f9-1] regionserver.HStore(310): Store=063b00081de8ec727d095e21e3cb33f9/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:10:59,445 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:10:59,446 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:10:59,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:10:59,471 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:10:59,473 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 063b00081de8ec727d095e21e3cb33f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64371273, jitterRate=-0.0407932847738266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:10:59,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 063b00081de8ec727d095e21e3cb33f9: 2023-07-15 16:10:59,479 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9., pid=11, masterSystemTime=1689437459420 2023-07-15 16:10:59,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:10:59,483 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:10:59,484 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=063b00081de8ec727d095e21e3cb33f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:10:59,485 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689437459484"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437459484"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437459484"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437459484"}]},"ts":"1689437459484"} 2023-07-15 16:10:59,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-15 16:10:59,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 063b00081de8ec727d095e21e3cb33f9, server=jenkins-hbase4.apache.org,43477,1689437455090 in 222 msec 2023-07-15 16:10:59,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-15 16:10:59,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=063b00081de8ec727d095e21e3cb33f9, ASSIGN in 386 msec 2023-07-15 16:10:59,497 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:10:59,497 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437459497"}]},"ts":"1689437459497"} 2023-07-15 16:10:59,505 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-15 16:10:59,508 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:10:59,511 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 501 msec 2023-07-15 16:10:59,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-15 16:10:59,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-15 16:10:59,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-15 16:11:00,857 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:11:01,266 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:11:01,276 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40005_jobhistory____.z0suhq/webapp 2023-07-15 16:11:01,466 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-15 16:11:01,466 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-15 16:11:01,467 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 16:11:01,470 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 16:11:01,585 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:02,073 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:02,452 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-15 16:11:02,500 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40005 2023-07-15 16:11:03,424 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:11:03,731 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-15 16:11:03,733 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-15 16:11:03,734 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-15 16:11:03,828 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:03,829 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-15 16:11:03,829 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:03,829 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-15 16:11:03,830 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 16:11:03,830 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-15 16:11:03,830 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:03,830 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-15 16:11:03,830 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 16:11:03,830 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-15 16:11:03,851 WARN [Listener at jenkins-hbase4.apache.org/33451] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:11:03,977 WARN [Listener at jenkins-hbase4.apache.org/33451] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 16:11:03,978 INFO [Listener at jenkins-hbase4.apache.org/33451] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:11:03,987 INFO [Listener at jenkins-hbase4.apache.org/33451] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33677_cluster____.j3t2s2/webapp 2023-07-15 16:11:04,062 INFO [Listener at jenkins-hbase4.apache.org/33451] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 16:11:04,062 INFO [Listener at jenkins-hbase4.apache.org/33451] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-15 16:11:04,063 INFO [Listener at jenkins-hbase4.apache.org/33451] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 16:11:04,063 INFO [Listener at jenkins-hbase4.apache.org/33451] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 16:11:04,073 INFO [Listener at jenkins-hbase4.apache.org/33451] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:04,272 INFO [Listener at jenkins-hbase4.apache.org/33451] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:04,370 INFO [Listener at jenkins-hbase4.apache.org/33451] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:04,379 INFO [Listener at jenkins-hbase4.apache.org/33451] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33677 2023-07-15 16:11:05,039 WARN [Listener at jenkins-hbase4.apache.org/45569] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:11:05,070 WARN [Listener at jenkins-hbase4.apache.org/45569] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 16:11:05,071 INFO [Listener at jenkins-hbase4.apache.org/45569] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:11:05,086 INFO [Listener at jenkins-hbase4.apache.org/45569] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41287_node____.wltsq6/webapp 2023-07-15 16:11:05,149 INFO [Listener at jenkins-hbase4.apache.org/45569] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 16:11:05,149 INFO [Listener at jenkins-hbase4.apache.org/45569] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 16:11:05,150 INFO [Listener at jenkins-hbase4.apache.org/45569] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 16:11:05,150 INFO [Listener at jenkins-hbase4.apache.org/45569] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 16:11:05,162 INFO [Listener at jenkins-hbase4.apache.org/45569] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:05,199 INFO [Listener at jenkins-hbase4.apache.org/45569] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:05,302 INFO [Listener at jenkins-hbase4.apache.org/45569] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:05,319 INFO [Listener at jenkins-hbase4.apache.org/45569] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41287 2023-07-15 16:11:05,596 WARN [Listener at jenkins-hbase4.apache.org/38899] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-15 16:11:05,602 WARN [Listener at jenkins-hbase4.apache.org/38899] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-15 16:11:05,602 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): jetty-6.1.26 2023-07-15 16:11:05,609 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33727_node____.aiidt2/webapp 2023-07-15 16:11:05,660 INFO [Listener at jenkins-hbase4.apache.org/38899] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-15 16:11:05,660 INFO [Listener at jenkins-hbase4.apache.org/38899] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-15 16:11:05,660 INFO [Listener at jenkins-hbase4.apache.org/38899] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-15 16:11:05,660 INFO [Listener at jenkins-hbase4.apache.org/38899] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-15 16:11:05,668 INFO [Listener at jenkins-hbase4.apache.org/38899] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:05,681 INFO [Listener at jenkins-hbase4.apache.org/38899] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:05,746 INFO [Listener at jenkins-hbase4.apache.org/38899] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-15 16:11:05,751 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33727 2023-07-15 16:11:05,777 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-15 16:11:05,778 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:05,840 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=290, ProcessCount=177, AvailableMemoryMB=4904 2023-07-15 16:11:05,840 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-15 16:11:05,856 DEBUG [Listener at jenkins-hbase4.apache.org/38899] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-15 16:11:05,861 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-15 16:11:05,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 16:11:05,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:05,875 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:11:05,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-15 16:11:05,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:05,878 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:11:05,883 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:05,884 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:05,887 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891 empty. 2023-07-15 16:11:05,887 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb empty. 2023-07-15 16:11:05,888 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:05,888 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:05,888 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 16:11:05,927 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-15 16:11:05,929 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 846d6659f358557f44f38302724aa0bb, NAME => 'testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:11:05,929 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 974fd6a837e8afe7bef924c310c10891, NAME => 'testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:11:05,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:05,968 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 846d6659f358557f44f38302724aa0bb, disabling compactions & flushes 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 974fd6a837e8afe7bef924c310c10891, disabling compactions & flushes 2023-07-15 16:11:05,969 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:05,969 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. after waiting 0 ms 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. after waiting 0 ms 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:05,969 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:05,969 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 974fd6a837e8afe7bef924c310c10891: 2023-07-15 16:11:05,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 846d6659f358557f44f38302724aa0bb: 2023-07-15 16:11:05,973 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:11:05,975 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437465975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437465975"}]},"ts":"1689437465975"} 2023-07-15 16:11:05,975 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437465975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437465975"}]},"ts":"1689437465975"} 2023-07-15 16:11:05,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:06,029 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:11:06,032 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:11:06,032 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437466032"}]},"ts":"1689437466032"} 2023-07-15 16:11:06,035 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-15 16:11:06,041 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:11:06,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:11:06,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:11:06,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:11:06,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:11:06,043 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=846d6659f358557f44f38302724aa0bb, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=974fd6a837e8afe7bef924c310c10891, ASSIGN}] 2023-07-15 16:11:06,046 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=846d6659f358557f44f38302724aa0bb, ASSIGN 2023-07-15 16:11:06,047 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=974fd6a837e8afe7bef924c310c10891, ASSIGN 2023-07-15 16:11:06,048 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=974fd6a837e8afe7bef924c310c10891, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1689437455210; forceNewPlan=false, retain=false 2023-07-15 16:11:06,048 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=846d6659f358557f44f38302724aa0bb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33799,1689437455269; forceNewPlan=false, retain=false 2023-07-15 16:11:06,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:06,198 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:11:06,201 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=974fd6a837e8afe7bef924c310c10891, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:06,201 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=846d6659f358557f44f38302724aa0bb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:06,201 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437466201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437466201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437466201"}]},"ts":"1689437466201"} 2023-07-15 16:11:06,201 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437466201"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437466201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437466201"}]},"ts":"1689437466201"} 2023-07-15 16:11:06,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 974fd6a837e8afe7bef924c310c10891, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:11:06,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 846d6659f358557f44f38302724aa0bb, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:11:06,360 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:06,360 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:11:06,364 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:11:06,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:06,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 974fd6a837e8afe7bef924c310c10891, NAME => 'testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:11:06,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. service=AccessControlService 2023-07-15 16:11:06,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:06,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:06,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:06,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:06,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:06,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:06,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 846d6659f358557f44f38302724aa0bb, NAME => 'testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:11:06,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. service=AccessControlService 2023-07-15 16:11:06,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:06,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:06,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:06,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:06,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:06,374 INFO [StoreOpener-974fd6a837e8afe7bef924c310c10891-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:06,375 INFO [StoreOpener-846d6659f358557f44f38302724aa0bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:06,378 DEBUG [StoreOpener-974fd6a837e8afe7bef924c310c10891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/cf 2023-07-15 16:11:06,379 DEBUG [StoreOpener-974fd6a837e8afe7bef924c310c10891-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/cf 2023-07-15 16:11:06,379 DEBUG [StoreOpener-846d6659f358557f44f38302724aa0bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/cf 2023-07-15 16:11:06,379 DEBUG [StoreOpener-846d6659f358557f44f38302724aa0bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/cf 2023-07-15 16:11:06,383 INFO [StoreOpener-846d6659f358557f44f38302724aa0bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 846d6659f358557f44f38302724aa0bb columnFamilyName cf 2023-07-15 16:11:06,383 INFO [StoreOpener-974fd6a837e8afe7bef924c310c10891-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 974fd6a837e8afe7bef924c310c10891 columnFamilyName cf 2023-07-15 16:11:06,386 INFO [StoreOpener-846d6659f358557f44f38302724aa0bb-1] regionserver.HStore(310): Store=846d6659f358557f44f38302724aa0bb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:06,388 INFO [StoreOpener-974fd6a837e8afe7bef924c310c10891-1] regionserver.HStore(310): Store=974fd6a837e8afe7bef924c310c10891/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:06,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:06,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:06,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:06,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:06,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:06,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:06,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 974fd6a837e8afe7bef924c310c10891; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59110537, jitterRate=-0.11918435990810394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:06,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 974fd6a837e8afe7bef924c310c10891: 2023-07-15 16:11:06,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 846d6659f358557f44f38302724aa0bb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61236365, jitterRate=-0.08750705420970917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:06,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 846d6659f358557f44f38302724aa0bb: 2023-07-15 16:11:06,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891., pid=15, masterSystemTime=1689437466357 2023-07-15 16:11:06,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb., pid=16, masterSystemTime=1689437466360 2023-07-15 16:11:06,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:06,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:06,419 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=974fd6a837e8afe7bef924c310c10891, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:06,419 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437466419"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437466419"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437466419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437466419"}]},"ts":"1689437466419"} 2023-07-15 16:11:06,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:06,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:06,424 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=846d6659f358557f44f38302724aa0bb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:06,425 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437466424"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437466424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437466424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437466424"}]},"ts":"1689437466424"} 2023-07-15 16:11:06,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-15 16:11:06,429 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 974fd6a837e8afe7bef924c310c10891, server=jenkins-hbase4.apache.org,46287,1689437455210 in 220 msec 2023-07-15 16:11:06,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=974fd6a837e8afe7bef924c310c10891, ASSIGN in 386 msec 2023-07-15 16:11:06,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-15 16:11:06,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 846d6659f358557f44f38302724aa0bb, server=jenkins-hbase4.apache.org,33799,1689437455269 in 223 msec 2023-07-15 16:11:06,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-15 16:11:06,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=846d6659f358557f44f38302724aa0bb, ASSIGN in 393 msec 2023-07-15 16:11:06,442 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:11:06,442 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437466442"}]},"ts":"1689437466442"} 2023-07-15 16:11:06,444 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-15 16:11:06,447 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:11:06,452 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-15 16:11:06,458 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:06,461 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:06,466 DEBUG [hconnection-0xc9ae8e0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:06,470 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-15 16:11:06,479 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 16:11:06,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:06,510 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:06,510 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:06,510 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:06,510 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:06,510 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:11:06,518 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:06,519 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:06,519 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:06,519 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:06,521 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:06,521 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:06,523 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:06,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 651 msec 2023-07-15 16:11:06,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-15 16:11:06,985 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-15 16:11:06,990 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 16:11:06,992 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:06,994 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:07,022 DEBUG [hconnection-0xebd2f59-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:07,028 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:07,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:07,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437467048 (current time:1689437467048). 2023-07-15 16:11:07,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:07,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x0816b9e9 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:07,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a371710, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:07,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:07,060 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:07,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0816b9e9 to 127.0.0.1:62768 2023-07-15 16:11:07,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:07,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x30d9164f to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:07,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2532143e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:07,077 DEBUG [hconnection-0x3b876a35-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:07,078 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:07,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:07,085 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:07,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30d9164f to 127.0.0.1:62768 2023-07-15 16:11:07,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:07,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 16:11:07,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:07,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:07,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:07,137 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:07,139 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689438067139 2023-07-15 16:11:07,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:07,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 16:11:07,142 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:07,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:07,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-15 16:11:07,145 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:07,146 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689438067146 2023-07-15 16:11:07,147 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:07,147 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:07,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,171 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-15 16:11:07,171 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,172 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 16:11:07,172 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 16:11:07,173 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,173 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,177 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,178 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,178 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,177 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,178 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,178 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,179 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,179 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 16:11:07,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 16:11:07,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:07,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:07,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-15 16:11:07,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,182 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:07,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,184 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:07,184 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:07,184 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,184 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,184 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,185 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:07,187 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:07,186 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:07,187 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:07,189 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,189 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,189 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,189 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,190 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,190 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,190 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:07,190 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,190 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:07,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,194 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,194 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 16:11:07,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51de22b0[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:07,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-15 16:11:07,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51de22b0[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:07,200 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 16:11:07,200 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,202 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,202 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,202 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:07,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:11:07,203 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:07,204 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:07,212 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:07,212 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. started... 2023-07-15 16:11:07,208 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,209 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:07,208 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:07,208 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:07,213 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. started... 2023-07-15 16:11:07,213 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:07,213 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:07,215 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 974fd6a837e8afe7bef924c310c10891: 2023-07-15 16:11:07,215 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 846d6659f358557f44f38302724aa0bb: 2023-07-15 16:11:07,216 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,216 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,222 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:07,222 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:07,226 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:07,226 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:07,247 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:07,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:07,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:07,253 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:07,284 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. completed. 2023-07-15 16:11:07,284 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:07,284 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:07,285 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:07,285 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,285 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:07,285 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:11:07,287 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. completed. 2023-07-15 16:11:07,287 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:07,287 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:11:07,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,290 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:07,290 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,290 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:07,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,291 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:07,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33799,1689437455269': 2023-07-15 16:11:07,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 16:11:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:11:07,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 16:11:07,304 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-15 16:11:07,304 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:07,304 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:07,304 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,304 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:07,308 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,308 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,310 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,310 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,311 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,316 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,316 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,317 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,336 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,336 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,336 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,337 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,337 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,338 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,337 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:07,338 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,339 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-15 16:11:07,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:11:07,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,338 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:07,340 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 16:11:07,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,453 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:07,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:07,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:07,458 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:11:07,505 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 16:11:07,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,506 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:07,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689437467139Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689437467368 (+229 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689437467368Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689437467368Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689437467393 (+25 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689437467427 (+34 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689437467505 (+78 ms) 2023-07-15 16:11:07,508 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:07,510 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 366 msec 2023-07-15 16:11:07,758 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:07,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:07,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:07,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:07,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:07,792 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-15 16:11:07,792 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:07,793 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:07,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:07,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437467808 (current time:1689437467808). 2023-07-15 16:11:07,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:07,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x1def083b to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:07,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ce98944, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:07,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:07,819 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:07,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1def083b to 127.0.0.1:62768 2023-07-15 16:11:07,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:07,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x534e004a to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:07,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@368564c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:07,833 DEBUG [hconnection-0x66f678f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:07,835 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:07,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:07,840 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:07,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x534e004a to 127.0.0.1:62768 2023-07-15 16:11:07,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:07,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-15 16:11:07,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:07,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:07,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:07,846 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:07,848 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689438067848 2023-07-15 16:11:07,848 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-15 16:11:07,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-15 16:11:07,849 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:07,849 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:07,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:07,852 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-15 16:11:07,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-07-15 16:11:07,854 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:07,855 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689438067855 2023-07-15 16:11:07,878 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-15 16:11:07,878 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-15 16:11:07,878 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,879 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-15 16:11:07,879 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-15 16:11:07,880 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,880 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,881 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,881 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,882 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,882 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,882 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,883 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,883 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,883 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 16:11:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,884 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 16:11:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-15 16:11:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,884 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:07,884 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-15 16:11:07,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 16:11:07,887 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:07,887 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 16:11:07,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-15 16:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-15 16:11:07,896 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:07,897 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:07,897 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:07,897 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:07,897 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:07,898 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-15 16:11:07,898 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-15 16:11:07,899 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-15 16:11:07,901 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,901 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,902 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:07,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,903 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:07,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 16:11:07,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385cba3d[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:07,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:07,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:07,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:07,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:07,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-15 16:11:07,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385cba3d[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:07,909 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-15 16:11:07,909 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:07,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:07,913 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:07,913 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:07,913 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-15 16:11:07,913 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:07,914 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:07,914 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:07,913 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:11:07,914 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. started... 2023-07-15 16:11:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:07,914 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:07,914 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:07,914 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. started... 2023-07-15 16:11:07,914 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 974fd6a837e8afe7bef924c310c10891 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 16:11:07,914 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 846d6659f358557f44f38302724aa0bb 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 16:11:07,917 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:07,917 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:07,917 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:07,950 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:07,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:07,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:07,951 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:08,053 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715cf4428c0e8fe49beb10d0982a5bc5385 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715cf4428c0e8fe49beb10d0982a5bc5385 2023-07-15 16:11:08,053 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307154d1c6bc7340b4a5f83877f3d94d8c0f0 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307154d1c6bc7340b4a5f83877f3d94d8c0f0 2023-07-15 16:11:08,084 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/.tmp/cf/f01d79bd663646548f4cf71909669b56 2023-07-15 16:11:08,089 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/.tmp/cf/85fbc0df49c44e0a8995717f60f19df8 2023-07-15 16:11:08,097 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/.tmp/cf/f01d79bd663646548f4cf71909669b56 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/cf/f01d79bd663646548f4cf71909669b56 2023-07-15 16:11:08,099 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/.tmp/cf/85fbc0df49c44e0a8995717f60f19df8 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/cf/85fbc0df49c44e0a8995717f60f19df8 2023-07-15 16:11:08,107 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/cf/85fbc0df49c44e0a8995717f60f19df8, entries=4, sequenceid=6, filesize=5.6 K 2023-07-15 16:11:08,109 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/cf/f01d79bd663646548f4cf71909669b56, entries=46, sequenceid=6, filesize=12.6 K 2023-07-15 16:11:08,111 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 846d6659f358557f44f38302724aa0bb in 197ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:08,112 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 16:11:08,112 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 974fd6a837e8afe7bef924c310c10891 in 198ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:08,112 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-15 16:11:08,114 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 974fd6a837e8afe7bef924c310c10891: 2023-07-15 16:11:08,114 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 846d6659f358557f44f38302724aa0bb: 2023-07-15 16:11:08,115 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 16:11:08,115 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:08,115 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/cf/f01d79bd663646548f4cf71909669b56] hfiles 2023-07-15 16:11:08,115 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/cf/f01d79bd663646548f4cf71909669b56 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 16:11:08,115 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 16:11:08,115 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:08,115 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/cf/85fbc0df49c44e0a8995717f60f19df8] hfiles 2023-07-15 16:11:08,115 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/cf/85fbc0df49c44e0a8995717f60f19df8 for snapshot=snaptb0-testExportWithTargetName 2023-07-15 16:11:08,152 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:08,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:08,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:08,155 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:11:08,158 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. completed. 2023-07-15 16:11:08,158 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:08,158 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:08,158 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:08,158 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,158 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. completed. 2023-07-15 16:11:08,158 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:08,158 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:08,159 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:11:08,159 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:08,159 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:08,159 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,159 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-15 16:11:08,159 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:11:08,161 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,161 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:08,161 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:08,161 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:08,162 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,162 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-15 16:11:08,163 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:08,163 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-15 16:11:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:08,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:08,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:08,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:11:08,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-15 16:11:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:08,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:08,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33799,1689437455269': 2023-07-15 16:11:08,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-15 16:11:08,177 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-15 16:11:08,177 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:08,177 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:08,177 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-15 16:11:08,177 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:08,179 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,179 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:08,179 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,179 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,179 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:08,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,179 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:08,179 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:08,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:08,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:08,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:08,181 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:08,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:08,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,182 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:08,183 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,185 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:08,185 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,186 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:08,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:08,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:08,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-15 16:11:08,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:08,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:08,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:08,197 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:08,197 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-15 16:11:08,197 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:08,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-15 16:11:08,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:08,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:08,198 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:08,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-15 16:11:08,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-15 16:11:08,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:08,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:11:08,199 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,200 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:08,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307154d1c6bc7340b4a5f83877f3d94d8c0f0, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715cf4428c0e8fe49beb10d0982a5bc5385] mob files 2023-07-15 16:11:08,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307154d1c6bc7340b4a5f83877f3d94d8c0f0 2023-07-15 16:11:08,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715cf4428c0e8fe49beb10d0982a5bc5385 2023-07-15 16:11:08,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-15 16:11:08,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,308 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-15 16:11:08,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,308 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-15 16:11:08,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689437467848Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689437468216 (+368 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689437468216Loading Region manifests for snaptb0-testExportWithTargetName at 1689437468217 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689437468222 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689437468247 (+25 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689437468308 (+61 ms) 2023-07-15 16:11:08,310 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-15 16:11:08,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 462 msec 2023-07-15 16:11:08,455 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:08,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-15 16:11:08,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:08,459 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459 2023-07-15 16:11:08,460 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34451, tgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459, rawTgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459, srcFsUri=hdfs://localhost:34451, srcDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:11:08,507 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:11:08,507 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-418519136_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 16:11:08,507 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9, snapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-15 16:11:08,544 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-15 16:11:08,720 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,721 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,721 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:08,722 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:09,754 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-971458035155004361.jar 2023-07-15 16:11:09,754 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:09,755 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:09,824 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-1686616185092278563.jar 2023-07-15 16:11:09,825 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:09,825 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:09,826 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:09,826 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:09,827 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:09,827 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:09,827 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:11:09,828 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:11:09,828 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:11:09,829 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:11:09,829 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:11:09,830 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:11:09,830 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:11:09,831 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:11:09,831 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:11:09,832 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:11:09,836 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:09,837 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:09,837 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:09,837 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:09,838 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:09,838 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:09,839 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:11,302 WARN [Listener at jenkins-hbase4.apache.org/38899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:11:11,310 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-15 16:11:11,335 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-15 16:11:11,882 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:11,885 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:11,891 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:11:12,656 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:17,904 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:20,191 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:23,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:25,298 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:11:25,300 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:11:25,311 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-15 16:11:25,311 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:11:25,312 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:11:25,312 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-15 16:11:25,313 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-15 16:11:25,313 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-15 16:11:25,313 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459/.hbase-snapshot/testExportWithTargetName 2023-07-15 16:11:25,313 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-15 16:11:25,313 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437468459/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-15 16:11:25,324 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-15 16:11:25,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-15 16:11:25,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:25,344 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437485343"}]},"ts":"1689437485343"} 2023-07-15 16:11:25,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 16:11:25,346 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-15 16:11:25,348 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-15 16:11:25,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=846d6659f358557f44f38302724aa0bb, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=974fd6a837e8afe7bef924c310c10891, UNASSIGN}] 2023-07-15 16:11:25,352 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=846d6659f358557f44f38302724aa0bb, UNASSIGN 2023-07-15 16:11:25,352 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=974fd6a837e8afe7bef924c310c10891, UNASSIGN 2023-07-15 16:11:25,353 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=974fd6a837e8afe7bef924c310c10891, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:25,353 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=846d6659f358557f44f38302724aa0bb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:25,354 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437485353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437485353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437485353"}]},"ts":"1689437485353"} 2023-07-15 16:11:25,354 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437485353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437485353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437485353"}]},"ts":"1689437485353"} 2023-07-15 16:11:25,356 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 974fd6a837e8afe7bef924c310c10891, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:11:25,359 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 846d6659f358557f44f38302724aa0bb, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:11:25,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 16:11:25,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:25,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:25,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 974fd6a837e8afe7bef924c310c10891, disabling compactions & flushes 2023-07-15 16:11:25,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 846d6659f358557f44f38302724aa0bb, disabling compactions & flushes 2023-07-15 16:11:25,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:25,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:25,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:25,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:25,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. after waiting 0 ms 2023-07-15 16:11:25,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. after waiting 0 ms 2023-07-15 16:11:25,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:25,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:25,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:11:25,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:11:25,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:25,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb. 2023-07-15 16:11:25,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 846d6659f358557f44f38302724aa0bb: 2023-07-15 16:11:25,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:25,540 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891. 2023-07-15 16:11:25,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 974fd6a837e8afe7bef924c310c10891: 2023-07-15 16:11:25,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:25,543 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=846d6659f358557f44f38302724aa0bb, regionState=CLOSED 2023-07-15 16:11:25,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:25,544 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437485543"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437485543"}]},"ts":"1689437485543"} 2023-07-15 16:11:25,544 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=974fd6a837e8afe7bef924c310c10891, regionState=CLOSED 2023-07-15 16:11:25,544 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689437485544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437485544"}]},"ts":"1689437485544"} 2023-07-15 16:11:25,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-15 16:11:25,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 846d6659f358557f44f38302724aa0bb, server=jenkins-hbase4.apache.org,33799,1689437455269 in 186 msec 2023-07-15 16:11:25,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-15 16:11:25,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 974fd6a837e8afe7bef924c310c10891, server=jenkins-hbase4.apache.org,46287,1689437455210 in 190 msec 2023-07-15 16:11:25,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=846d6659f358557f44f38302724aa0bb, UNASSIGN in 198 msec 2023-07-15 16:11:25,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-15 16:11:25,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=974fd6a837e8afe7bef924c310c10891, UNASSIGN in 199 msec 2023-07-15 16:11:25,552 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437485552"}]},"ts":"1689437485552"} 2023-07-15 16:11:25,554 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-15 16:11:25,555 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-15 16:11:25,558 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 223 msec 2023-07-15 16:11:25,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-15 16:11:25,648 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-15 16:11:25,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-15 16:11:25,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:25,663 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:25,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-15 16:11:25,665 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:25,669 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-15 16:11:25,672 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:25,672 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:25,673 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:25,673 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:25,673 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:25,674 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:25,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 16:11:25,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 16:11:25,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 16:11:25,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-15 16:11:25,677 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:25,677 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:25,677 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:25,677 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:25,677 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:25,677 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:25,678 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/recovered.edits] 2023-07-15 16:11:25,678 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/recovered.edits] 2023-07-15 16:11:25,678 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-15 16:11:25,678 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:25,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 16:11:25,688 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/cf/f01d79bd663646548f4cf71909669b56 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/cf/f01d79bd663646548f4cf71909669b56 2023-07-15 16:11:25,688 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/cf/85fbc0df49c44e0a8995717f60f19df8 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/cf/85fbc0df49c44e0a8995717f60f19df8 2023-07-15 16:11:25,696 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891/recovered.edits/9.seqid 2023-07-15 16:11:25,696 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb/recovered.edits/9.seqid 2023-07-15 16:11:25,697 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/974fd6a837e8afe7bef924c310c10891 2023-07-15 16:11:25,698 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportWithTargetName/846d6659f358557f44f38302724aa0bb 2023-07-15 16:11:25,698 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-15 16:11:25,698 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-15 16:11:25,700 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-15 16:11:25,708 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307154d1c6bc7340b4a5f83877f3d94d8c0f0 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307154d1c6bc7340b4a5f83877f3d94d8c0f0 2023-07-15 16:11:25,710 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715cf4428c0e8fe49beb10d0982a5bc5385 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230715cf4428c0e8fe49beb10d0982a5bc5385 2023-07-15 16:11:25,710 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-15 16:11:25,714 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:25,738 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-15 16:11:25,742 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-15 16:11:25,745 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:25,745 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-15 16:11:25,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437485745"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:25,745 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437485745"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:25,748 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:11:25,748 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 846d6659f358557f44f38302724aa0bb, NAME => 'testtb-testExportWithTargetName,,1689437465868.846d6659f358557f44f38302724aa0bb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 974fd6a837e8afe7bef924c310c10891, NAME => 'testtb-testExportWithTargetName,1,1689437465868.974fd6a837e8afe7bef924c310c10891.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:11:25,748 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-15 16:11:25,748 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437485748"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:25,752 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-15 16:11:25,756 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-15 16:11:25,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 102 msec 2023-07-15 16:11:25,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-15 16:11:25,786 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-15 16:11:25,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-15 16:11:25,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-15 16:11:25,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-15 16:11:25,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-15 16:11:25,846 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=750 (was 704) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:38404 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1319 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1622700078_1 at /127.0.0.1:38386 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:41067 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:32893 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1622700078_1 at /127.0.0.1:46864 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x4be88134-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:56540 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:46890 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=449 (was 290) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=3136 (was 4904) 2023-07-15 16:11:25,846 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-15 16:11:25,869 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=750, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=449, ProcessCount=183, AvailableMemoryMB=3136 2023-07-15 16:11:25,869 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-07-15 16:11:25,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 16:11:25,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:25,878 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:11:25,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-15 16:11:25,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 16:11:25,881 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:11:25,884 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:25,884 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:25,885 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7 empty. 2023-07-15 16:11:25,885 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58 empty. 2023-07-15 16:11:25,885 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:25,886 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:25,886 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 16:11:25,903 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 16:11:25,906 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6e8b7c15524e55be49da6bd914b57f58, NAME => 'testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:11:25,906 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1ef1f6205a22c7dc622b040855e3aab7, NAME => 'testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:11:25,931 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:25,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 1ef1f6205a22c7dc622b040855e3aab7, disabling compactions & flushes 2023-07-15 16:11:25,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:25,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:25,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. after waiting 0 ms 2023-07-15 16:11:25,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:25,932 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:25,932 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 1ef1f6205a22c7dc622b040855e3aab7: 2023-07-15 16:11:25,935 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:25,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6e8b7c15524e55be49da6bd914b57f58, disabling compactions & flushes 2023-07-15 16:11:25,936 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:25,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:25,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. after waiting 0 ms 2023-07-15 16:11:25,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:25,936 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:25,936 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6e8b7c15524e55be49da6bd914b57f58: 2023-07-15 16:11:25,939 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:11:25,940 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437485940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437485940"}]},"ts":"1689437485940"} 2023-07-15 16:11:25,941 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437485940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437485940"}]},"ts":"1689437485940"} 2023-07-15 16:11:25,943 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:11:25,945 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:11:25,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437485945"}]},"ts":"1689437485945"} 2023-07-15 16:11:25,947 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 16:11:25,950 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:11:25,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:11:25,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:11:25,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:11:25,952 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:11:25,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1ef1f6205a22c7dc622b040855e3aab7, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e8b7c15524e55be49da6bd914b57f58, ASSIGN}] 2023-07-15 16:11:25,955 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1ef1f6205a22c7dc622b040855e3aab7, ASSIGN 2023-07-15 16:11:25,955 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e8b7c15524e55be49da6bd914b57f58, ASSIGN 2023-07-15 16:11:25,956 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1ef1f6205a22c7dc622b040855e3aab7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43477,1689437455090; forceNewPlan=false, retain=false 2023-07-15 16:11:25,957 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e8b7c15524e55be49da6bd914b57f58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1689437455210; forceNewPlan=false, retain=false 2023-07-15 16:11:25,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 16:11:26,106 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:11:26,109 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6e8b7c15524e55be49da6bd914b57f58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:26,109 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1ef1f6205a22c7dc622b040855e3aab7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:26,109 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437486109"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437486109"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437486109"}]},"ts":"1689437486109"} 2023-07-15 16:11:26,110 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437486109"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437486109"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437486109"}]},"ts":"1689437486109"} 2023-07-15 16:11:26,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 6e8b7c15524e55be49da6bd914b57f58, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:11:26,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 1ef1f6205a22c7dc622b040855e3aab7, server=jenkins-hbase4.apache.org,43477,1689437455090}] 2023-07-15 16:11:26,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 16:11:26,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:26,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6e8b7c15524e55be49da6bd914b57f58, NAME => 'testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:11:26,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. service=AccessControlService 2023-07-15 16:11:26,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:26,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:26,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:26,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:26,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:26,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:26,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ef1f6205a22c7dc622b040855e3aab7, NAME => 'testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:11:26,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. service=AccessControlService 2023-07-15 16:11:26,275 INFO [StoreOpener-6e8b7c15524e55be49da6bd914b57f58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:26,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:26,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:26,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:26,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:26,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:26,276 DEBUG [StoreOpener-6e8b7c15524e55be49da6bd914b57f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/cf 2023-07-15 16:11:26,276 DEBUG [StoreOpener-6e8b7c15524e55be49da6bd914b57f58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/cf 2023-07-15 16:11:26,277 INFO [StoreOpener-1ef1f6205a22c7dc622b040855e3aab7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:26,277 INFO [StoreOpener-6e8b7c15524e55be49da6bd914b57f58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e8b7c15524e55be49da6bd914b57f58 columnFamilyName cf 2023-07-15 16:11:26,278 DEBUG [StoreOpener-1ef1f6205a22c7dc622b040855e3aab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/cf 2023-07-15 16:11:26,278 DEBUG [StoreOpener-1ef1f6205a22c7dc622b040855e3aab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/cf 2023-07-15 16:11:26,279 INFO [StoreOpener-6e8b7c15524e55be49da6bd914b57f58-1] regionserver.HStore(310): Store=6e8b7c15524e55be49da6bd914b57f58/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:26,279 INFO [StoreOpener-1ef1f6205a22c7dc622b040855e3aab7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ef1f6205a22c7dc622b040855e3aab7 columnFamilyName cf 2023-07-15 16:11:26,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:26,281 INFO [StoreOpener-1ef1f6205a22c7dc622b040855e3aab7-1] regionserver.HStore(310): Store=1ef1f6205a22c7dc622b040855e3aab7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:26,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:26,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:26,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:26,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:26,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:26,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:26,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6e8b7c15524e55be49da6bd914b57f58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61068482, jitterRate=-0.0900087058544159}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:26,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6e8b7c15524e55be49da6bd914b57f58: 2023-07-15 16:11:26,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:26,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58., pid=30, masterSystemTime=1689437486264 2023-07-15 16:11:26,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1ef1f6205a22c7dc622b040855e3aab7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62678176, jitterRate=-0.06602239608764648}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:26,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1ef1f6205a22c7dc622b040855e3aab7: 2023-07-15 16:11:26,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7., pid=31, masterSystemTime=1689437486266 2023-07-15 16:11:26,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:26,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:26,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6e8b7c15524e55be49da6bd914b57f58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:26,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:26,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:26,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437486292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437486292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437486292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437486292"}]},"ts":"1689437486292"} 2023-07-15 16:11:26,293 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=1ef1f6205a22c7dc622b040855e3aab7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:26,293 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437486293"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437486293"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437486293"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437486293"}]},"ts":"1689437486293"} 2023-07-15 16:11:26,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-15 16:11:26,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 6e8b7c15524e55be49da6bd914b57f58, server=jenkins-hbase4.apache.org,46287,1689437455210 in 183 msec 2023-07-15 16:11:26,303 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-15 16:11:26,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 1ef1f6205a22c7dc622b040855e3aab7, server=jenkins-hbase4.apache.org,43477,1689437455090 in 183 msec 2023-07-15 16:11:26,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e8b7c15524e55be49da6bd914b57f58, ASSIGN in 347 msec 2023-07-15 16:11:26,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-15 16:11:26,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1ef1f6205a22c7dc622b040855e3aab7, ASSIGN in 355 msec 2023-07-15 16:11:26,310 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:11:26,310 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437486310"}]},"ts":"1689437486310"} 2023-07-15 16:11:26,312 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 16:11:26,315 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:11:26,315 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-15 16:11:26,317 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:11:26,318 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:26,318 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:26,318 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:26,318 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:26,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:26,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:26,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:26,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:26,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 446 msec 2023-07-15 16:11:26,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-15 16:11:26,486 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-15 16:11:26,499 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 16:11:26,499 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:26,502 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:26,516 DEBUG [hconnection-0xebd2f59-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:26,529 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:26,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:26,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437486538 (current time:1689437486538). 2023-07-15 16:11:26,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:26,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x21d03875 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:26,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21ce48f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:26,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:26,554 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:26,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21d03875 to 127.0.0.1:62768 2023-07-15 16:11:26,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:26,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x53c57657 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:26,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73f6ffca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:26,575 DEBUG [hconnection-0x20acf8cd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:26,579 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:26,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:26,585 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:26,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53c57657 to 127.0.0.1:62768 2023-07-15 16:11:26,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:26,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:11:26,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:26,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:26,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:26,593 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:26,594 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689438086594 2023-07-15 16:11:26,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:26,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 16:11:26,596 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:26,596 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:26,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:26,598 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:26,600 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-15 16:11:26,601 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:26,602 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689438086602 2023-07-15 16:11:26,696 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:26,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:11:26,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:26,698 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:26,898 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:26,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:11:26,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:26,899 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:11:27,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,029 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-15 16:11:27,029 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:27,029 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 16:11:27,029 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 16:11:27,030 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,030 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,033 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,033 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,033 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,033 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,033 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,033 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,034 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,034 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:27,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,035 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:27,035 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:27,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,035 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:27,035 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:27,037 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:27,037 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:27,037 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:27,035 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:27,037 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:27,039 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:27,040 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:27,040 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:27,040 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:27,040 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:27,040 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:27,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,041 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,045 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:27,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,045 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,046 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 16:11:27,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56616b70[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:27,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-15 16:11:27,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56616b70[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:27,050 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 16:11:27,050 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,052 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,052 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,052 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:27,053 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:27,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:27,053 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,053 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:27,053 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:27,053 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:27,053 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:27,054 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. started... 2023-07-15 16:11:27,053 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. started... 2023-07-15 16:11:27,054 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:11:27,055 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e8b7c15524e55be49da6bd914b57f58: 2023-07-15 16:11:27,055 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ef1f6205a22c7dc622b040855e3aab7: 2023-07-15 16:11:27,055 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,055 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,055 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:27,055 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:27,055 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:27,055 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:27,057 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:27,057 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:27,057 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:27,078 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. completed. 2023-07-15 16:11:27,079 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:27,079 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:27,079 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:27,079 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,079 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:27,079 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:11:27,082 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:27,082 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,082 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:27,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,083 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:27,083 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. completed. 2023-07-15 16:11:27,083 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:27,084 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:27,084 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:27,084 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,084 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:27,084 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:11:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,085 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,086 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:27,086 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:27,086 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:27,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43477,1689437455090': 2023-07-15 16:11:27,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 16:11:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:11:27,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 16:11:27,093 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-15 16:11:27,093 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:27,094 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:27,094 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,094 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:27,097 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,097 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,097 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,097 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,097 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,097 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,097 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,098 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,099 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,100 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,102 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,102 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,103 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,107 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,107 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,107 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,107 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,107 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,107 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,107 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,108 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,108 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,108 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-15 16:11:27,108 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:27,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:11:27,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,108 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,111 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,111 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,111 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,111 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,111 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,111 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,111 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 16:11:27,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,190 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 16:11:27,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,191 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:27,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689437486594Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689437487129 (+535 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689437487129Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689437487129Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689437487133 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689437487149 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689437487190 (+41 ms) 2023-07-15 16:11:27,195 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:27,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 600 msec 2023-07-15 16:11:27,200 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:27,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:11:27,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:27,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:27,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:27,213 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-15 16:11:27,213 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:27,213 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:27,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:27,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437487226 (current time:1689437487226). 2023-07-15 16:11:27,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:27,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x49679acf to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:27,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30124f85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:27,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:27,238 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:27,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49679acf to 127.0.0.1:62768 2023-07-15 16:11:27,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:27,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x110e7bb6 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:27,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46062fc1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:27,249 DEBUG [hconnection-0x129b456c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:27,250 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:27,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:27,256 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:27,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x110e7bb6 to 127.0.0.1:62768 2023-07-15 16:11:27,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:27,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:11:27,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:27,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:27,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:27,261 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:27,262 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689438087262 2023-07-15 16:11:27,262 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-15 16:11:27,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:11:27,263 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:27,264 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:27,265 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:11:27,265 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:27,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-15 16:11:27,269 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:27,270 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689438087270 2023-07-15 16:11:27,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-15 16:11:27,288 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-15 16:11:27,289 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:27,290 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-15 16:11:27,290 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-15 16:11:27,291 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,291 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,292 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,292 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,292 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,292 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,292 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,293 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,293 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:27,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 16:11:27,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 16:11:27,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,294 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:27,294 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:27,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 16:11:27,294 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:27,294 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:27,294 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,299 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:27,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,300 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:27,300 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:27,295 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 16:11:27,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,300 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:27,300 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:27,301 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:27,301 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:27,301 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:27,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,303 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,303 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,305 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,305 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,305 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:27,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-15 16:11:27,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,305 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-15 16:11:27,305 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:27,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-15 16:11:27,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,306 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-15 16:11:27,306 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:27,307 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-15 16:11:27,307 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-15 16:11:27,307 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-15 16:11:27,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:27,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,309 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,309 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,309 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,309 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 16:11:27,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a87c034[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:27,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-15 16:11:27,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a87c034[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:27,313 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 16:11:27,313 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:27,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,314 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:27,315 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:27,314 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:11:27,315 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:11:27,315 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,315 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:27,315 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:27,315 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:27,315 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:27,315 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:27,315 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. started... 2023-07-15 16:11:27,315 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:27,315 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:27,315 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. started... 2023-07-15 16:11:27,315 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1ef1f6205a22c7dc622b040855e3aab7 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 16:11:27,315 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6e8b7c15524e55be49da6bd914b57f58 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 16:11:27,316 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:27,316 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:27,316 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:27,350 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307159e63ee4fe89c4eb4b0826651edb4b327 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307159e63ee4fe89c4eb4b0826651edb4b327 2023-07-15 16:11:27,353 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307150b074d18c93c4f0fb7fc6a7c394f08fd to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307150b074d18c93c4f0fb7fc6a7c394f08fd 2023-07-15 16:11:27,361 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/.tmp/cf/a6cfba198f3c47c3b5e700bf6fc98d55 2023-07-15 16:11:27,364 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:27,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:11:27,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:27,365 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:27,368 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/.tmp/cf/5c8c4fec7e5c434f90787024ef4affe7 2023-07-15 16:11:27,369 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/.tmp/cf/a6cfba198f3c47c3b5e700bf6fc98d55 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/cf/a6cfba198f3c47c3b5e700bf6fc98d55 2023-07-15 16:11:27,377 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/cf/a6cfba198f3c47c3b5e700bf6fc98d55, entries=4, sequenceid=6, filesize=5.6 K 2023-07-15 16:11:27,379 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 1ef1f6205a22c7dc622b040855e3aab7 in 64ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:27,379 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-15 16:11:27,379 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1ef1f6205a22c7dc622b040855e3aab7: 2023-07-15 16:11:27,380 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/.tmp/cf/5c8c4fec7e5c434f90787024ef4affe7 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/cf/5c8c4fec7e5c434f90787024ef4affe7 2023-07-15 16:11:27,380 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 16:11:27,380 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:27,380 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/cf/a6cfba198f3c47c3b5e700bf6fc98d55] hfiles 2023-07-15 16:11:27,380 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/cf/a6cfba198f3c47c3b5e700bf6fc98d55 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 16:11:27,386 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/cf/5c8c4fec7e5c434f90787024ef4affe7, entries=46, sequenceid=6, filesize=12.7 K 2023-07-15 16:11:27,387 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6e8b7c15524e55be49da6bd914b57f58 in 72ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:27,389 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e8b7c15524e55be49da6bd914b57f58: 2023-07-15 16:11:27,390 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 16:11:27,390 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:27,390 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/cf/5c8c4fec7e5c434f90787024ef4affe7] hfiles 2023-07-15 16:11:27,390 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/cf/5c8c4fec7e5c434f90787024ef4affe7 for snapshot=snaptb0-testExportFileSystemState 2023-07-15 16:11:27,395 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. completed. 2023-07-15 16:11:27,395 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:27,395 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:27,395 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:27,395 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,395 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:27,395 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:11:27,399 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. completed. 2023-07-15 16:11:27,399 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:27,399 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:27,399 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:27,399 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,399 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-15 16:11:27,399 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:11:27,401 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:27,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:27,403 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-15 16:11:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-15 16:11:27,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:27,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:27,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43477,1689437455090': 2023-07-15 16:11:27,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 16:11:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:27,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:27,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:11:27,413 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 16:11:27,413 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-15 16:11:27,413 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:27,413 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:27,413 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-15 16:11:27,413 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:27,415 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,415 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,415 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,415 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,415 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,415 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,416 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,416 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:27,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,417 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:27,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,417 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:27,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:27,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:27,419 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-15 16:11:27,420 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,420 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,424 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,424 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,424 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,424 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:27,424 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:27,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:27,425 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:27,425 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:27,425 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-15 16:11:27,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,427 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,427 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-15 16:11:27,427 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,427 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-15 16:11:27,427 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,427 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:11:27,427 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,427 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:27,428 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,428 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:27,428 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:27,428 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,428 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307150b074d18c93c4f0fb7fc6a7c394f08fd, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307159e63ee4fe89c4eb4b0826651edb4b327] mob files 2023-07-15 16:11:27,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307150b074d18c93c4f0fb7fc6a7c394f08fd 2023-07-15 16:11:27,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307159e63ee4fe89c4eb4b0826651edb4b327 2023-07-15 16:11:27,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:27,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:27,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-15 16:11:27,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-15 16:11:27,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,491 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689437487262Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689437487437 (+175 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689437487437Loading Region manifests for snaptb0-testExportFileSystemState at 1689437487437Writing data manifest for snaptb0-testExportFileSystemState at 1689437487441 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689437487451 (+10 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689437487490 (+39 ms) 2023-07-15 16:11:27,494 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-15 16:11:27,496 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 231 msec 2023-07-15 16:11:27,565 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:27,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:11:27,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:27,567 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567 2023-07-15 16:11:27,567 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34451, tgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567, rawTgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567, srcFsUri=hdfs://localhost:34451, srcDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:11:27,591 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:11:27,592 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_927106067_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:27,592 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9, snapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-15 16:11:27,608 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-15 16:11:28,047 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:28,048 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:28,049 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:28,049 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:29,032 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-4914818269478119058.jar 2023-07-15 16:11:29,032 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:29,033 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:29,105 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-7496345142220627550.jar 2023-07-15 16:11:29,106 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:29,106 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:29,106 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:29,107 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:29,107 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:29,107 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:29,108 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:11:29,108 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:11:29,109 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:11:29,109 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:11:29,110 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:11:29,111 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:11:29,111 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:11:29,112 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:11:29,112 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:11:29,113 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:11:29,114 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:29,115 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:29,116 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:29,116 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:29,117 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:29,117 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:29,118 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:29,561 WARN [Listener at jenkins-hbase4.apache.org/38899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:11:29,567 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-15 16:11:29,569 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-15 16:11:29,640 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0001_000001 (auth:SIMPLE) 2023-07-15 16:11:29,705 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:29,705 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:29,788 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0002_000001 (auth:SIMPLE) 2023-07-15 16:11:31,137 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:11:34,837 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0002_000001 (auth:SIMPLE) 2023-07-15 16:11:37,108 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0002_000001 (auth:SIMPLE) 2023-07-15 16:11:40,750 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0002_000001 (auth:SIMPLE) 2023-07-15 16:11:41,831 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:11:41,834 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:11:41,850 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-15 16:11:41,850 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:11:41,851 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:11:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 16:11:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 16:11:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 16:11:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-15 16:11:41,852 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-15 16:11:41,852 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437487567/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-15 16:11:41,866 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-15 16:11:41,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-15 16:11:41,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:41,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 16:11:41,872 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437501871"}]},"ts":"1689437501871"} 2023-07-15 16:11:41,873 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 16:11:41,875 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-15 16:11:41,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1ef1f6205a22c7dc622b040855e3aab7, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e8b7c15524e55be49da6bd914b57f58, UNASSIGN}] 2023-07-15 16:11:41,878 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1ef1f6205a22c7dc622b040855e3aab7, UNASSIGN 2023-07-15 16:11:41,878 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e8b7c15524e55be49da6bd914b57f58, UNASSIGN 2023-07-15 16:11:41,879 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1ef1f6205a22c7dc622b040855e3aab7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:41,879 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6e8b7c15524e55be49da6bd914b57f58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:41,879 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437501879"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437501879"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437501879"}]},"ts":"1689437501879"} 2023-07-15 16:11:41,879 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437501879"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437501879"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437501879"}]},"ts":"1689437501879"} 2023-07-15 16:11:41,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 1ef1f6205a22c7dc622b040855e3aab7, server=jenkins-hbase4.apache.org,43477,1689437455090}] 2023-07-15 16:11:41,882 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 6e8b7c15524e55be49da6bd914b57f58, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:11:41,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 16:11:42,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:42,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1ef1f6205a22c7dc622b040855e3aab7, disabling compactions & flushes 2023-07-15 16:11:42,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:42,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:42,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. after waiting 0 ms 2023-07-15 16:11:42,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:42,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:42,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6e8b7c15524e55be49da6bd914b57f58, disabling compactions & flushes 2023-07-15 16:11:42,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:42,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:42,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. after waiting 0 ms 2023-07-15 16:11:42,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:42,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:11:42,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:11:42,051 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:42,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7. 2023-07-15 16:11:42,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1ef1f6205a22c7dc622b040855e3aab7: 2023-07-15 16:11:42,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:11:42,053 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58. 2023-07-15 16:11:42,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6e8b7c15524e55be49da6bd914b57f58: 2023-07-15 16:11:42,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:42,055 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=1ef1f6205a22c7dc622b040855e3aab7, regionState=CLOSED 2023-07-15 16:11:42,055 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437502055"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437502055"}]},"ts":"1689437502055"} 2023-07-15 16:11:42,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:42,056 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6e8b7c15524e55be49da6bd914b57f58, regionState=CLOSED 2023-07-15 16:11:42,056 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689437502056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437502056"}]},"ts":"1689437502056"} 2023-07-15 16:11:42,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-15 16:11:42,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 1ef1f6205a22c7dc622b040855e3aab7, server=jenkins-hbase4.apache.org,43477,1689437455090 in 176 msec 2023-07-15 16:11:42,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-15 16:11:42,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 6e8b7c15524e55be49da6bd914b57f58, server=jenkins-hbase4.apache.org,46287,1689437455210 in 176 msec 2023-07-15 16:11:42,062 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=1ef1f6205a22c7dc622b040855e3aab7, UNASSIGN in 185 msec 2023-07-15 16:11:42,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-15 16:11:42,064 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e8b7c15524e55be49da6bd914b57f58, UNASSIGN in 185 msec 2023-07-15 16:11:42,065 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437502065"}]},"ts":"1689437502065"} 2023-07-15 16:11:42,067 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 16:11:42,069 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-15 16:11:42,072 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 204 msec 2023-07-15 16:11:42,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-15 16:11:42,175 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-15 16:11:42,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-15 16:11:42,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:42,183 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:42,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-15 16:11:42,185 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:42,186 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-15 16:11:42,190 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:42,190 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:42,190 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:42,190 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:42,191 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:42,191 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 16:11:42,191 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 16:11:42,191 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-15 16:11:42,192 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:42,192 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,192 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,192 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:42,192 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,193 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-15 16:11:42,192 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-15 16:11:42,193 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 16:11:42,193 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,193 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:42,193 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/recovered.edits] 2023-07-15 16:11:42,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 16:11:42,197 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/recovered.edits] 2023-07-15 16:11:42,202 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/cf/5c8c4fec7e5c434f90787024ef4affe7 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/cf/5c8c4fec7e5c434f90787024ef4affe7 2023-07-15 16:11:42,202 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/cf/a6cfba198f3c47c3b5e700bf6fc98d55 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/cf/a6cfba198f3c47c3b5e700bf6fc98d55 2023-07-15 16:11:42,207 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58/recovered.edits/9.seqid 2023-07-15 16:11:42,207 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7/recovered.edits/9.seqid 2023-07-15 16:11:42,208 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/6e8b7c15524e55be49da6bd914b57f58 2023-07-15 16:11:42,208 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemState/1ef1f6205a22c7dc622b040855e3aab7 2023-07-15 16:11:42,208 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-15 16:11:42,209 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-15 16:11:42,209 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-15 16:11:42,213 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307150b074d18c93c4f0fb7fc6a7c394f08fd to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307150b074d18c93c4f0fb7fc6a7c394f08fd 2023-07-15 16:11:42,215 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307159e63ee4fe89c4eb4b0826651edb4b327 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307159e63ee4fe89c4eb4b0826651edb4b327 2023-07-15 16:11:42,215 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-15 16:11:42,218 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:42,225 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-15 16:11:42,228 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-15 16:11:42,230 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:42,230 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-15 16:11:42,230 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437502230"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:42,230 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437502230"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:42,241 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:11:42,241 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1ef1f6205a22c7dc622b040855e3aab7, NAME => 'testtb-testExportFileSystemState,,1689437485871.1ef1f6205a22c7dc622b040855e3aab7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6e8b7c15524e55be49da6bd914b57f58, NAME => 'testtb-testExportFileSystemState,1,1689437485871.6e8b7c15524e55be49da6bd914b57f58.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:11:42,241 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-15 16:11:42,241 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437502241"}]},"ts":"9223372036854775807"} 2023-07-15 16:11:42,244 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-15 16:11:42,246 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-15 16:11:42,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 70 msec 2023-07-15 16:11:42,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-15 16:11:42,296 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-15 16:11:42,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-15 16:11:42,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-15 16:11:42,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-15 16:11:42,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-15 16:11:42,333 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:45569 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:51318 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:34028 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-4323335_1 at /127.0.0.1:51296 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2028 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:46526 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:43247 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-4323335_1 at /127.0.0.1:46512 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=409 (was 449), ProcessCount=183 (was 183), AvailableMemoryMB=3005 (was 3136) 2023-07-15 16:11:42,334 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 16:11:42,354 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=409, ProcessCount=183, AvailableMemoryMB=3004 2023-07-15 16:11:42,354 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 16:11:42,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 16:11:42,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:11:42,359 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:11:42,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-15 16:11:42,360 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:11:42,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 16:11:42,363 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7 2023-07-15 16:11:42,363 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:11:42,363 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7 empty. 2023-07-15 16:11:42,363 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12 empty. 2023-07-15 16:11:42,364 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7 2023-07-15 16:11:42,364 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:11:42,364 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 16:11:42,377 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-15 16:11:42,378 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 18b5f338d4e44693732c51c5347751f7, NAME => 'testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:11:42,378 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8502a19d9484eb273a70bc8d9b316c12, NAME => 'testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 8502a19d9484eb273a70bc8d9b316c12, disabling compactions & flushes 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 18b5f338d4e44693732c51c5347751f7, disabling compactions & flushes 2023-07-15 16:11:42,398 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:42,398 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. after waiting 0 ms 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. after waiting 0 ms 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:42,398 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:42,398 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:42,399 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:42,399 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 8502a19d9484eb273a70bc8d9b316c12: 2023-07-15 16:11:42,399 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 18b5f338d4e44693732c51c5347751f7: 2023-07-15 16:11:42,402 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:11:42,403 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437502402"}]},"ts":"1689437502402"} 2023-07-15 16:11:42,403 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437502402"}]},"ts":"1689437502402"} 2023-07-15 16:11:42,405 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:11:42,407 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:11:42,407 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437502407"}]},"ts":"1689437502407"} 2023-07-15 16:11:42,409 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-15 16:11:42,414 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:11:42,416 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:11:42,416 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:11:42,416 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:11:42,416 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:11:42,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=18b5f338d4e44693732c51c5347751f7, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8502a19d9484eb273a70bc8d9b316c12, ASSIGN}] 2023-07-15 16:11:42,420 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8502a19d9484eb273a70bc8d9b316c12, ASSIGN 2023-07-15 16:11:42,420 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=18b5f338d4e44693732c51c5347751f7, ASSIGN 2023-07-15 16:11:42,421 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8502a19d9484eb273a70bc8d9b316c12, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43477,1689437455090; forceNewPlan=false, retain=false 2023-07-15 16:11:42,421 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=18b5f338d4e44693732c51c5347751f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1689437455210; forceNewPlan=false, retain=false 2023-07-15 16:11:42,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 16:11:42,572 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:11:42,575 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=18b5f338d4e44693732c51c5347751f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:42,575 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8502a19d9484eb273a70bc8d9b316c12, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:42,576 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437502575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437502575"}]},"ts":"1689437502575"} 2023-07-15 16:11:42,576 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437502575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437502575"}]},"ts":"1689437502575"} 2023-07-15 16:11:42,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 18b5f338d4e44693732c51c5347751f7, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:11:42,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 8502a19d9484eb273a70bc8d9b316c12, server=jenkins-hbase4.apache.org,43477,1689437455090}] 2023-07-15 16:11:42,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 16:11:42,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:42,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 18b5f338d4e44693732c51c5347751f7, NAME => 'testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:11:42,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:42,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8502a19d9484eb273a70bc8d9b316c12, NAME => 'testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. service=AccessControlService 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. service=AccessControlService 2023-07-15 16:11:42,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:42,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 18b5f338d4e44693732c51c5347751f7 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 18b5f338d4e44693732c51c5347751f7 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 18b5f338d4e44693732c51c5347751f7 2023-07-15 16:11:42,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:11:42,737 INFO [StoreOpener-8502a19d9484eb273a70bc8d9b316c12-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:11:42,737 INFO [StoreOpener-18b5f338d4e44693732c51c5347751f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 18b5f338d4e44693732c51c5347751f7 2023-07-15 16:11:42,738 DEBUG [StoreOpener-8502a19d9484eb273a70bc8d9b316c12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/cf 2023-07-15 16:11:42,738 DEBUG [StoreOpener-18b5f338d4e44693732c51c5347751f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/cf 2023-07-15 16:11:42,738 DEBUG [StoreOpener-8502a19d9484eb273a70bc8d9b316c12-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/cf 2023-07-15 16:11:42,738 DEBUG [StoreOpener-18b5f338d4e44693732c51c5347751f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/cf 2023-07-15 16:11:42,739 INFO [StoreOpener-8502a19d9484eb273a70bc8d9b316c12-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8502a19d9484eb273a70bc8d9b316c12 columnFamilyName cf 2023-07-15 16:11:42,739 INFO [StoreOpener-18b5f338d4e44693732c51c5347751f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18b5f338d4e44693732c51c5347751f7 columnFamilyName cf 2023-07-15 16:11:42,740 INFO [StoreOpener-8502a19d9484eb273a70bc8d9b316c12-1] regionserver.HStore(310): Store=8502a19d9484eb273a70bc8d9b316c12/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:42,740 INFO [StoreOpener-18b5f338d4e44693732c51c5347751f7-1] regionserver.HStore(310): Store=18b5f338d4e44693732c51c5347751f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:11:42,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:11:42,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7 2023-07-15 16:11:42,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:11:42,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7 2023-07-15 16:11:42,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:11:42,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 18b5f338d4e44693732c51c5347751f7 2023-07-15 16:11:42,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:42,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:11:42,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8502a19d9484eb273a70bc8d9b316c12; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63153280, jitterRate=-0.05894279479980469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:42,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 18b5f338d4e44693732c51c5347751f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75029568, jitterRate=0.1180276870727539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:11:42,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8502a19d9484eb273a70bc8d9b316c12: 2023-07-15 16:11:42,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 18b5f338d4e44693732c51c5347751f7: 2023-07-15 16:11:42,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12., pid=46, masterSystemTime=1689437502731 2023-07-15 16:11:42,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7., pid=45, masterSystemTime=1689437502730 2023-07-15 16:11:42,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:42,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:42,750 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=8502a19d9484eb273a70bc8d9b316c12, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:42,750 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437502750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437502750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437502750"}]},"ts":"1689437502750"} 2023-07-15 16:11:42,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:42,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:42,751 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=18b5f338d4e44693732c51c5347751f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:42,751 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437502751"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437502751"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437502751"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437502751"}]},"ts":"1689437502751"} 2023-07-15 16:11:42,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-15 16:11:42,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 8502a19d9484eb273a70bc8d9b316c12, server=jenkins-hbase4.apache.org,43477,1689437455090 in 173 msec 2023-07-15 16:11:42,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-15 16:11:42,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 18b5f338d4e44693732c51c5347751f7, server=jenkins-hbase4.apache.org,46287,1689437455210 in 175 msec 2023-07-15 16:11:42,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8502a19d9484eb273a70bc8d9b316c12, ASSIGN in 338 msec 2023-07-15 16:11:42,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-15 16:11:42,758 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=18b5f338d4e44693732c51c5347751f7, ASSIGN in 340 msec 2023-07-15 16:11:42,759 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:11:42,759 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437502759"}]},"ts":"1689437502759"} 2023-07-15 16:11:42,761 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-15 16:11:42,763 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:11:42,763 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-15 16:11:42,765 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 16:11:42,769 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,769 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,769 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,769 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:11:42,770 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:42,770 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:42,770 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:42,770 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-15 16:11:42,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 414 msec 2023-07-15 16:11:42,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-15 16:11:42,964 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-15 16:11:42,967 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 16:11:42,967 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:42,971 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:42,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:42,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437502984 (current time:1689437502984). 2023-07-15 16:11:42,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:42,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x6705d01c to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:42,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@582623df, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:42,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:42,996 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:42,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6705d01c to 127.0.0.1:62768 2023-07-15 16:11:42,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:42,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x3c124e9b to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:43,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@755eec35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:43,007 DEBUG [hconnection-0x1c0f019a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:43,010 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48348, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:43,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:43,017 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:43,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c124e9b to 127.0.0.1:62768 2023-07-15 16:11:43,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:43,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 16:11:43,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:43,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:43,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:43,025 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:43,027 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689438103027 2023-07-15 16:11:43,027 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 16:11:43,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:43,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:43,029 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:43,030 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:43,035 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:43,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 13 msec 2023-07-15 16:11:43,038 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:43,039 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689438103039 2023-07-15 16:11:43,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,053 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-15 16:11:43,054 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,055 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 16:11:43,055 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 16:11:43,055 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,055 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,057 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,057 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,057 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,057 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,057 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,057 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,058 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,058 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:43,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,059 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:43,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:43,059 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,060 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:43,060 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:43,060 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,059 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:43,062 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:43,062 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:43,062 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,060 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:43,065 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:43,065 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:43,065 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:43,062 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:43,065 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:43,067 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,067 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,067 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,068 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:43,070 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 16:11:43,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeca876[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-15 16:11:43,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeca876[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:43,075 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 16:11:43,075 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,076 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,076 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,076 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,077 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:43,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:11:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:43,077 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,077 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:43,077 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. started... 2023-07-15 16:11:43,077 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:43,077 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:43,077 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:43,077 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. started... 2023-07-15 16:11:43,077 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18b5f338d4e44693732c51c5347751f7: 2023-07-15 16:11:43,078 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8502a19d9484eb273a70bc8d9b316c12: 2023-07-15 16:11:43,079 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,079 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,079 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:43,079 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:43,079 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:43,079 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:11:43,083 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:43,083 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,083 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:43,098 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. completed. 2023-07-15 16:11:43,098 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:43,098 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. completed. 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,098 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:43,098 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:11:43,100 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:43,100 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,100 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,100 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:43,101 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:43,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,101 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:43,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43477,1689437455090': 2023-07-15 16:11:43,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 16:11:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:11:43,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 16:11:43,112 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-15 16:11:43,112 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:43,112 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:43,112 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,112 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:43,115 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,115 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,115 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,115 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,115 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,115 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,115 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,117 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,117 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,118 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,120 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,120 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,121 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,124 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,124 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,124 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,124 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,124 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,124 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,124 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,125 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,125 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,125 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,124 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,124 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-15 16:11:43,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:11:43,125 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,127 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,127 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,127 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,127 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,127 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,127 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 16:11:43,130 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:43,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:43,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:43,131 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:43,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,191 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 16:11:43,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,191 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-15 16:11:43,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689437503027Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689437503138 (+111 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689437503138Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689437503138Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689437503143 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689437503155 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689437503191 (+36 ms) 2023-07-15 16:11:43,194 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:43,199 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 167 msec 2023-07-15 16:11:43,331 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:43,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:43,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:43,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:43,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:11:43,342 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-15 16:11:43,342 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:43,342 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:11:43,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:43,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437503355 (current time:1689437503355). 2023-07-15 16:11:43,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:11:43,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x260a92da to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:43,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@506f9348, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:43,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:43,375 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:43,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x260a92da to 127.0.0.1:62768 2023-07-15 16:11:43,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:43,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x0a9df187 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:11:43,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78f32e4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:11:43,398 DEBUG [hconnection-0x542a17c9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:43,402 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:43,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:11:43,408 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:11:43,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a9df187 to 127.0.0.1:62768 2023-07-15 16:11:43,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:11:43,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-15 16:11:43,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:11:43,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:43,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:43,415 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:43,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-15 16:11:43,416 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689438103416 2023-07-15 16:11:43,416 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:11:43,416 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:11:43,416 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-15 16:11:43,422 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-15 16:11:43,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:43,424 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-15 16:11:43,424 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:43,425 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689438103425 2023-07-15 16:11:43,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-15 16:11:43,444 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-15 16:11:43,444 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,446 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-15 16:11:43,446 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-15 16:11:43,446 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,446 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,448 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,448 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,448 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,448 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,449 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,449 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,450 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,450 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,450 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:43,451 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-15 16:11:43,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 16:11:43,451 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:43,451 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 16:11:43,451 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:43,451 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,456 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:43,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-15 16:11:43,456 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:43,456 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-15 16:11:43,456 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:43,456 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:43,456 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:43,456 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:11:43,456 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:43,458 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-15 16:11:43,458 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-15 16:11:43,458 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-15 16:11:43,459 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,460 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,460 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,460 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,460 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,460 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:43,460 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,460 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,460 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:43,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,461 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,461 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:11:43,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 16:11:43,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773c6244[Count = 1] remaining members to acquire global barrier 2023-07-15 16:11:43,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-15 16:11:43,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773c6244[Count = 0] remaining members to acquire global barrier 2023-07-15 16:11:43,465 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-15 16:11:43,465 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:43,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:43,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,466 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,467 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:43,466 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-15 16:11:43,466 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:11:43,467 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:43,467 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:43,467 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:11:43,467 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:11:43,467 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:43,467 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,467 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:11:43,467 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. started... 2023-07-15 16:11:43,467 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:43,467 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. started... 2023-07-15 16:11:43,467 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 18b5f338d4e44693732c51c5347751f7 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-15 16:11:43,468 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8502a19d9484eb273a70bc8d9b316c12 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-15 16:11:43,472 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:43,472 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,472 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:43,498 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307157f82ee45e14940bc9ba30d60814d1933 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307157f82ee45e14940bc9ba30d60814d1933 2023-07-15 16:11:43,500 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307154d72aef3ab18463f8e20b2891dd51fab to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307154d72aef3ab18463f8e20b2891dd51fab 2023-07-15 16:11:43,510 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/.tmp/cf/78ec8b18858144929374776ba41678d2 2023-07-15 16:11:43,512 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/.tmp/cf/08deafde27c3495fbdce1cfa01b58dc5 2023-07-15 16:11:43,516 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:43,516 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/.tmp/cf/78ec8b18858144929374776ba41678d2 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/cf/78ec8b18858144929374776ba41678d2 2023-07-15 16:11:43,518 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/.tmp/cf/08deafde27c3495fbdce1cfa01b58dc5 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/cf/08deafde27c3495fbdce1cfa01b58dc5 2023-07-15 16:11:43,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:43,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:11:43,519 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:11:43,522 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/cf/78ec8b18858144929374776ba41678d2, entries=45, sequenceid=6, filesize=12.4 K 2023-07-15 16:11:43,523 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/cf/08deafde27c3495fbdce1cfa01b58dc5, entries=5, sequenceid=6, filesize=5.7 K 2023-07-15 16:11:43,524 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 8502a19d9484eb273a70bc8d9b316c12 in 55ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:43,524 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 16:11:43,524 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 18b5f338d4e44693732c51c5347751f7 in 57ms, sequenceid=6, compaction requested=false 2023-07-15 16:11:43,524 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 18b5f338d4e44693732c51c5347751f7: 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8502a19d9484eb273a70bc8d9b316c12: 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/cf/08deafde27c3495fbdce1cfa01b58dc5] hfiles 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/cf/08deafde27c3495fbdce1cfa01b58dc5 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/cf/78ec8b18858144929374776ba41678d2] hfiles 2023-07-15 16:11:43,526 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/cf/78ec8b18858144929374776ba41678d2 for snapshot=snaptb0-testConsecutiveExports 2023-07-15 16:11:43,540 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. completed. 2023-07-15 16:11:43,540 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:11:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:43,540 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:11:43,541 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:43,542 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,542 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,543 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. completed. 2023-07-15 16:11:43,543 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:11:43,543 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:11:43,543 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:11:43,543 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,543 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-15 16:11:43,543 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:11:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,545 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,545 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-15 16:11:43,545 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,545 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-15 16:11:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:11:43,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-15 16:11:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43477,1689437455090': 2023-07-15 16:11:43,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-15 16:11:43,551 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-15 16:11:43,551 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:11:43,551 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:11:43,551 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-15 16:11:43,551 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:11:43,552 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,552 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,552 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,552 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,553 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:11:43,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,553 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,552 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:11:43,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,553 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,554 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:11:43,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,554 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:11:43,556 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-15 16:11:43,556 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,557 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,565 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,565 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,565 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,565 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,565 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:11:43,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-15 16:11:43,565 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-15 16:11:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,565 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:11:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,565 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:11:43,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,565 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:11:43,567 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-15 16:11:43,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,567 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,567 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:11:43,567 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:11:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,567 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:11:43,567 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,567 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:11:43,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:11:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:11:43,567 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:11:43,568 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,568 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307157f82ee45e14940bc9ba30d60814d1933, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307154d72aef3ab18463f8e20b2891dd51fab] mob files 2023-07-15 16:11:43,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307157f82ee45e14940bc9ba30d60814d1933 2023-07-15 16:11:43,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307154d72aef3ab18463f8e20b2891dd51fab 2023-07-15 16:11:43,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-15 16:11:43,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-15 16:11:43,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,617 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689437503416Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689437503578 (+162 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689437503578Loading Region manifests for snaptb0-testConsecutiveExports at 1689437503578Writing data manifest for snaptb0-testConsecutiveExports at 1689437503583 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689437503592 (+9 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689437503616 (+24 ms) 2023-07-15 16:11:43,619 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-15 16:11:43,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 201 msec 2023-07-15 16:11:43,719 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:11:43,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-15 16:11:43,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:11:43,721 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721 2023-07-15 16:11:43,721 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721, srcFsUri=hdfs://localhost:34451, srcDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:11:43,745 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:11:43,745 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@242c62a3, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,745 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9, snapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 16:11:43,755 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:43,768 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:43,768 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:43,769 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:43,769 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,679 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-894549809119274746.jar 2023-07-15 16:11:44,680 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,680 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,788 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-8041451545005108965.jar 2023-07-15 16:11:44,788 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,789 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,789 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,789 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,790 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,790 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:44,790 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:11:44,791 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:11:44,791 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:11:44,792 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:11:44,792 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:11:44,792 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:11:44,793 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:11:44,793 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:11:44,793 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:11:44,794 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:11:44,794 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:44,795 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:44,795 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:44,796 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:44,796 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:44,796 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:44,797 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:45,253 WARN [Listener at jenkins-hbase4.apache.org/38899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:11:45,256 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 16:11:45,258 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-15 16:11:46,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:46,833 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:11:46,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0002_000001 (auth:SIMPLE) 2023-07-15 16:11:47,643 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:11:47,726 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0003_000001 (auth:SIMPLE) 2023-07-15 16:11:52,348 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0003_000001 (auth:SIMPLE) 2023-07-15 16:11:54,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0003_000001 (auth:SIMPLE) 2023-07-15 16:11:57,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0003_000001 (auth:SIMPLE) 2023-07-15 16:11:58,434 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:11:58,434 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:11:58,439 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 16:11:58,439 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:11:58,439 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:11:58,440 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:11:58,442 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 16:11:58,442 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 16:11:58,442 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2c338a09 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:11:58,442 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 16:11:58,443 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 16:11:58,444 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721, srcFsUri=hdfs://localhost:34451, srcDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:11:58,466 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:11:58,466 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@43be9a30, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:58,466 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9, snapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-15 16:11:58,477 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-15 16:11:58,489 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,490 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,490 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:58,490 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,456 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-5009574212250002343.jar 2023-07-15 16:11:59,457 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,457 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,540 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-2344618415412910527.jar 2023-07-15 16:11:59,541 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,541 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,541 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,542 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,542 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,542 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:11:59,543 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:11:59,543 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:11:59,544 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:11:59,544 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:11:59,544 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:11:59,545 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:11:59,545 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:11:59,545 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:11:59,546 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:11:59,546 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:11:59,547 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:59,547 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:59,548 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:59,548 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:59,548 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:11:59,549 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:59,549 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:11:59,935 WARN [Listener at jenkins-hbase4.apache.org/38899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:11:59,937 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-15 16:11:59,939 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-15 16:12:03,436 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:03,436 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:03,440 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0003_000001 (auth:SIMPLE) 2023-07-15 16:12:03,848 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0004_000001 (auth:SIMPLE) 2023-07-15 16:12:08,692 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0004_000001 (auth:SIMPLE) 2023-07-15 16:12:11,042 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0004_000001 (auth:SIMPLE) 2023-07-15 16:12:15,326 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0004_000001 (auth:SIMPLE) 2023-07-15 16:12:17,133 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:12:17,134 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:12:17,146 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-15 16:12:17,146 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:12:17,146 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:12:17,146 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:12:17,155 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 16:12:17,155 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 16:12:17,155 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2c338a09 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-15 16:12:17,155 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-15 16:12:17,155 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/local-export-1689437503721/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-15 16:12:17,173 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-15 16:12:17,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-15 16:12:17,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:17,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 16:12:17,179 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437537179"}]},"ts":"1689437537179"} 2023-07-15 16:12:17,181 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-15 16:12:17,188 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-15 16:12:17,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=18b5f338d4e44693732c51c5347751f7, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8502a19d9484eb273a70bc8d9b316c12, UNASSIGN}] 2023-07-15 16:12:17,193 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=18b5f338d4e44693732c51c5347751f7, UNASSIGN 2023-07-15 16:12:17,193 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8502a19d9484eb273a70bc8d9b316c12, UNASSIGN 2023-07-15 16:12:17,194 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=18b5f338d4e44693732c51c5347751f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:17,194 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8502a19d9484eb273a70bc8d9b316c12, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:17,195 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437537194"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437537194"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437537194"}]},"ts":"1689437537194"} 2023-07-15 16:12:17,195 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437537194"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437537194"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437537194"}]},"ts":"1689437537194"} 2023-07-15 16:12:17,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 18b5f338d4e44693732c51c5347751f7, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:12:17,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 8502a19d9484eb273a70bc8d9b316c12, server=jenkins-hbase4.apache.org,43477,1689437455090}] 2023-07-15 16:12:17,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 16:12:17,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 18b5f338d4e44693732c51c5347751f7 2023-07-15 16:12:17,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 18b5f338d4e44693732c51c5347751f7, disabling compactions & flushes 2023-07-15 16:12:17,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:12:17,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:12:17,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. after waiting 0 ms 2023-07-15 16:12:17,353 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:12:17,353 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:12:17,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8502a19d9484eb273a70bc8d9b316c12, disabling compactions & flushes 2023-07-15 16:12:17,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:12:17,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:12:17,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. after waiting 0 ms 2023-07-15 16:12:17,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:12:17,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:17,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:17,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:17,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7. 2023-07-15 16:12:17,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 18b5f338d4e44693732c51c5347751f7: 2023-07-15 16:12:17,369 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:17,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12. 2023-07-15 16:12:17,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8502a19d9484eb273a70bc8d9b316c12: 2023-07-15 16:12:17,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 18b5f338d4e44693732c51c5347751f7 2023-07-15 16:12:17,372 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=18b5f338d4e44693732c51c5347751f7, regionState=CLOSED 2023-07-15 16:12:17,372 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437537372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437537372"}]},"ts":"1689437537372"} 2023-07-15 16:12:17,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:12:17,372 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=8502a19d9484eb273a70bc8d9b316c12, regionState=CLOSED 2023-07-15 16:12:17,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689437537372"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437537372"}]},"ts":"1689437537372"} 2023-07-15 16:12:17,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-15 16:12:17,375 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 18b5f338d4e44693732c51c5347751f7, server=jenkins-hbase4.apache.org,46287,1689437455210 in 176 msec 2023-07-15 16:12:17,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-15 16:12:17,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 8502a19d9484eb273a70bc8d9b316c12, server=jenkins-hbase4.apache.org,43477,1689437455090 in 176 msec 2023-07-15 16:12:17,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=18b5f338d4e44693732c51c5347751f7, UNASSIGN in 184 msec 2023-07-15 16:12:17,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-15 16:12:17,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=8502a19d9484eb273a70bc8d9b316c12, UNASSIGN in 186 msec 2023-07-15 16:12:17,380 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437537380"}]},"ts":"1689437537380"} 2023-07-15 16:12:17,381 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-15 16:12:17,383 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-15 16:12:17,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 209 msec 2023-07-15 16:12:17,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-15 16:12:17,485 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-15 16:12:17,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-15 16:12:17,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:17,490 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:17,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-15 16:12:17,493 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-15 16:12:17,496 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:17,496 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:17,496 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:17,497 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:17,496 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:17,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 16:12:17,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 16:12:17,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 16:12:17,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-15 16:12:17,500 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:17,500 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:17,500 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:17,500 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:17,500 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-15 16:12:17,500 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:17,500 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:17,500 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:17,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 16:12:17,505 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7 2023-07-15 16:12:17,505 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:12:17,509 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/recovered.edits] 2023-07-15 16:12:17,512 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/recovered.edits] 2023-07-15 16:12:17,516 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/cf/08deafde27c3495fbdce1cfa01b58dc5 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/cf/08deafde27c3495fbdce1cfa01b58dc5 2023-07-15 16:12:17,526 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/cf/78ec8b18858144929374776ba41678d2 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/cf/78ec8b18858144929374776ba41678d2 2023-07-15 16:12:17,528 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7/recovered.edits/9.seqid 2023-07-15 16:12:17,528 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/18b5f338d4e44693732c51c5347751f7 2023-07-15 16:12:17,530 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12/recovered.edits/9.seqid 2023-07-15 16:12:17,531 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testConsecutiveExports/8502a19d9484eb273a70bc8d9b316c12 2023-07-15 16:12:17,531 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-15 16:12:17,531 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-15 16:12:17,532 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-15 16:12:17,536 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307157f82ee45e14940bc9ba30d60814d1933 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307157f82ee45e14940bc9ba30d60814d1933 2023-07-15 16:12:17,539 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307154d72aef3ab18463f8e20b2891dd51fab to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307154d72aef3ab18463f8e20b2891dd51fab 2023-07-15 16:12:17,540 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-15 16:12:17,543 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:17,549 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-15 16:12:17,557 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-15 16:12:17,558 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:17,558 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-15 16:12:17,558 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437537558"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:17,558 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437537558"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:17,569 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:12:17,570 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 18b5f338d4e44693732c51c5347751f7, NAME => 'testtb-testConsecutiveExports,,1689437502355.18b5f338d4e44693732c51c5347751f7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8502a19d9484eb273a70bc8d9b316c12, NAME => 'testtb-testConsecutiveExports,1,1689437502355.8502a19d9484eb273a70bc8d9b316c12.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:12:17,570 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-15 16:12:17,570 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437537570"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:17,572 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-15 16:12:17,574 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-15 16:12:17,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 88 msec 2023-07-15 16:12:17,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-15 16:12:17,603 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-15 16:12:17,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-15 16:12:17,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-15 16:12:17,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-15 16:12:17,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-15 16:12:17,653 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=745 (was 761), OpenFileDescriptor=895 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 409) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2631 (was 3004) 2023-07-15 16:12:17,653 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-15 16:12:17,679 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=895, MaxFileDescriptor=60000, SystemLoadAverage=562, ProcessCount=185, AvailableMemoryMB=2628 2023-07-15 16:12:17,680 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-15 16:12:17,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 16:12:17,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:17,693 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:12:17,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-15 16:12:17,694 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:12:17,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 16:12:17,699 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:17,708 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9 empty. 2023-07-15 16:12:17,708 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:17,718 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:17,724 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436 empty. 2023-07-15 16:12:17,725 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:17,725 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 16:12:17,771 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-15 16:12:17,775 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => bf02f1efc4abd07d8af23807e6f9c8e9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:12:17,775 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 04d1251fcd3d5176eba48a3094f30436, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:12:17,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 16:12:17,824 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 04d1251fcd3d5176eba48a3094f30436, disabling compactions & flushes 2023-07-15 16:12:17,825 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. after waiting 0 ms 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:17,825 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 04d1251fcd3d5176eba48a3094f30436: 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing bf02f1efc4abd07d8af23807e6f9c8e9, disabling compactions & flushes 2023-07-15 16:12:17,825 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. after waiting 0 ms 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:17,825 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:17,825 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for bf02f1efc4abd07d8af23807e6f9c8e9: 2023-07-15 16:12:17,829 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:12:17,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437537830"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437537830"}]},"ts":"1689437537830"} 2023-07-15 16:12:17,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437537830"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437537830"}]},"ts":"1689437537830"} 2023-07-15 16:12:17,838 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:12:17,839 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:12:17,839 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437537839"}]},"ts":"1689437537839"} 2023-07-15 16:12:17,840 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-15 16:12:17,844 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:12:17,845 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:12:17,845 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:12:17,845 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:12:17,846 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:12:17,846 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bf02f1efc4abd07d8af23807e6f9c8e9, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04d1251fcd3d5176eba48a3094f30436, ASSIGN}] 2023-07-15 16:12:17,849 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04d1251fcd3d5176eba48a3094f30436, ASSIGN 2023-07-15 16:12:17,849 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bf02f1efc4abd07d8af23807e6f9c8e9, ASSIGN 2023-07-15 16:12:17,850 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04d1251fcd3d5176eba48a3094f30436, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1689437455210; forceNewPlan=false, retain=false 2023-07-15 16:12:17,852 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bf02f1efc4abd07d8af23807e6f9c8e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33799,1689437455269; forceNewPlan=false, retain=false 2023-07-15 16:12:18,000 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:12:18,004 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=04d1251fcd3d5176eba48a3094f30436, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,004 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437538004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437538004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437538004"}]},"ts":"1689437538004"} 2023-07-15 16:12:18,004 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bf02f1efc4abd07d8af23807e6f9c8e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,005 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437538004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437538004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437538004"}]},"ts":"1689437538004"} 2023-07-15 16:12:18,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 04d1251fcd3d5176eba48a3094f30436, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:12:18,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 16:12:18,013 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure bf02f1efc4abd07d8af23807e6f9c8e9, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:12:18,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:18,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 04d1251fcd3d5176eba48a3094f30436, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:12:18,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. service=AccessControlService 2023-07-15 16:12:18,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:18,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:18,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:18,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:18,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:18,164 INFO [StoreOpener-04d1251fcd3d5176eba48a3094f30436-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:18,168 DEBUG [StoreOpener-04d1251fcd3d5176eba48a3094f30436-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/cf 2023-07-15 16:12:18,168 DEBUG [StoreOpener-04d1251fcd3d5176eba48a3094f30436-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/cf 2023-07-15 16:12:18,170 INFO [StoreOpener-04d1251fcd3d5176eba48a3094f30436-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 04d1251fcd3d5176eba48a3094f30436 columnFamilyName cf 2023-07-15 16:12:18,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:18,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bf02f1efc4abd07d8af23807e6f9c8e9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:12:18,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. service=AccessControlService 2023-07-15 16:12:18,171 INFO [StoreOpener-04d1251fcd3d5176eba48a3094f30436-1] regionserver.HStore(310): Store=04d1251fcd3d5176eba48a3094f30436/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:18,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:18,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:18,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:18,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:18,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:18,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:18,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:18,173 INFO [StoreOpener-bf02f1efc4abd07d8af23807e6f9c8e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:18,174 DEBUG [StoreOpener-bf02f1efc4abd07d8af23807e6f9c8e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/cf 2023-07-15 16:12:18,174 DEBUG [StoreOpener-bf02f1efc4abd07d8af23807e6f9c8e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/cf 2023-07-15 16:12:18,175 INFO [StoreOpener-bf02f1efc4abd07d8af23807e6f9c8e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf02f1efc4abd07d8af23807e6f9c8e9 columnFamilyName cf 2023-07-15 16:12:18,176 INFO [StoreOpener-bf02f1efc4abd07d8af23807e6f9c8e9-1] regionserver.HStore(310): Store=bf02f1efc4abd07d8af23807e6f9c8e9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:18,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:18,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:18,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:18,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:18,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 04d1251fcd3d5176eba48a3094f30436; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66265809, jitterRate=-0.012562498450279236}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:18,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 04d1251fcd3d5176eba48a3094f30436: 2023-07-15 16:12:18,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436., pid=60, masterSystemTime=1689437538159 2023-07-15 16:12:18,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:18,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:18,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:18,182 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=04d1251fcd3d5176eba48a3094f30436, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,182 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437538182"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437538182"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437538182"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437538182"}]},"ts":"1689437538182"} 2023-07-15 16:12:18,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:18,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bf02f1efc4abd07d8af23807e6f9c8e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67229624, jitterRate=0.001799464225769043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:18,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bf02f1efc4abd07d8af23807e6f9c8e9: 2023-07-15 16:12:18,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9., pid=61, masterSystemTime=1689437538164 2023-07-15 16:12:18,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-15 16:12:18,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 04d1251fcd3d5176eba48a3094f30436, server=jenkins-hbase4.apache.org,46287,1689437455210 in 177 msec 2023-07-15 16:12:18,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:18,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:18,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04d1251fcd3d5176eba48a3094f30436, ASSIGN in 340 msec 2023-07-15 16:12:18,188 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=bf02f1efc4abd07d8af23807e6f9c8e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,188 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437538188"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437538188"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437538188"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437538188"}]},"ts":"1689437538188"} 2023-07-15 16:12:18,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-15 16:12:18,191 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure bf02f1efc4abd07d8af23807e6f9c8e9, server=jenkins-hbase4.apache.org,33799,1689437455269 in 177 msec 2023-07-15 16:12:18,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-15 16:12:18,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bf02f1efc4abd07d8af23807e6f9c8e9, ASSIGN in 345 msec 2023-07-15 16:12:18,194 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:12:18,194 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437538194"}]},"ts":"1689437538194"} 2023-07-15 16:12:18,195 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-15 16:12:18,202 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:12:18,203 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-15 16:12:18,204 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 16:12:18,210 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:18,210 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:18,210 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:18,210 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:18,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,213 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:18,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 530 msec 2023-07-15 16:12:18,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-15 16:12:18,313 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-15 16:12:18,316 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,316 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:18,318 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:18,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:18,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437538332 (current time:1689437538332). 2023-07-15 16:12:18,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:18,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x0293bc37 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:18,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11ff4abd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:18,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:18,344 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:18,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0293bc37 to 127.0.0.1:62768 2023-07-15 16:12:18,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:18,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x2f0e2b63 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:18,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30e358b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:18,356 DEBUG [hconnection-0x5ba246b2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:18,357 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:18,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:18,363 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:18,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f0e2b63 to 127.0.0.1:62768 2023-07-15 16:12:18,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:18,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 16:12:18,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:18,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:18,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:18,369 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:18,369 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689438138369 2023-07-15 16:12:18,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:18,371 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:18,371 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:18,372 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:18,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:18,373 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-15 16:12:18,374 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:18,374 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689438138374 2023-07-15 16:12:18,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,390 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 16:12:18,390 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:18,392 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 16:12:18,392 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 16:12:18,392 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,392 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,394 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,394 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,394 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,394 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,394 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,394 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,395 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,395 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:18,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,396 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-15 16:12:18,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,396 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:18,396 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:18,396 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:18,396 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:18,397 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:18,397 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:18,396 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:18,398 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,399 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:18,399 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:18,399 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:18,397 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:18,400 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:18,400 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:18,400 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:18,399 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:18,400 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:18,402 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,402 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,403 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,403 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,402 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,403 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,403 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,403 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:18,403 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:18,403 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,403 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:18,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 16:12:18,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2adbad38[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:18,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 16:12:18,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2adbad38[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:18,409 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 16:12:18,409 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,410 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,410 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,410 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,410 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,410 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:18,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:18,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,411 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,411 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:18,410 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:18,411 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:18,411 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. started... 2023-07-15 16:12:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:12:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:18,412 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:18,412 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04d1251fcd3d5176eba48a3094f30436: 2023-07-15 16:12:18,412 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:18,413 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. started... 2023-07-15 16:12:18,413 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,413 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bf02f1efc4abd07d8af23807e6f9c8e9: 2023-07-15 16:12:18,413 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:18,413 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:18,413 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,413 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:18,413 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:18,417 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:18,417 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:18,417 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:18,441 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. completed. 2023-07-15 16:12:18,441 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:18,442 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. completed. 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:12:18,442 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:18,442 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:12:18,445 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,445 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,445 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:18,445 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:18,446 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:18,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,446 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:18,446 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,446 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:18,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33799,1689437455269': 2023-07-15 16:12:18,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 16:12:18,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:12:18,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 16:12:18,457 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 16:12:18,458 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:18,458 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:18,458 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,458 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:18,460 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,460 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,460 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,460 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,460 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,460 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,460 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,461 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,462 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,462 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,465 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,465 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,466 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,469 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,469 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,469 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,469 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,469 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,470 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,469 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,470 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,470 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,470 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,470 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,470 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:18,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,470 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,471 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:18,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,470 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,472 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:12:18,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,471 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,472 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,472 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,472 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 16:12:18,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 16:12:18,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:18,473 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:18,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 16:12:18,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,547 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689437538370Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689437538485 (+115 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689437538485Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689437538485Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689437538492 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689437538508 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689437538547 (+39 ms) 2023-07-15 16:12:18,551 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:18,552 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 180 msec 2023-07-15 16:12:18,673 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:18,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 16:12:18,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:18,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:18,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:18,683 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,683 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:18,684 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:18,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:18,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437538696 (current time:1689437538696). 2023-07-15 16:12:18,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:18,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x416325d0 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:18,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a8003d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:18,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:18,709 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:18,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x416325d0 to 127.0.0.1:62768 2023-07-15 16:12:18,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:18,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x2750c1e0 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:18,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fc53d7f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:18,718 DEBUG [hconnection-0x15316795-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:18,721 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:18,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:18,727 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:18,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2750c1e0 to 127.0.0.1:62768 2023-07-15 16:12:18,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:18,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-15 16:12:18,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:18,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:18,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:18,733 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:18,734 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689438138734 2023-07-15 16:12:18,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-15 16:12:18,735 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:18,735 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:18,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:18,737 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-15 16:12:18,739 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-15 16:12:18,740 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:18,740 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689438138740 2023-07-15 16:12:18,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,755 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-15 16:12:18,755 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:18,756 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-15 16:12:18,756 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-15 16:12:18,757 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,757 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,759 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,759 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,759 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,759 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,760 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,760 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,760 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,760 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:18,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,761 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:18,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:18,761 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:18,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,761 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:18,763 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-15 16:12:18,764 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:18,764 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:18,763 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:18,764 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:18,764 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:18,764 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:18,764 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:18,765 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-15 16:12:18,765 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-15 16:12:18,765 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-15 16:12:18,766 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,767 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,767 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,767 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:18,767 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,767 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,767 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,768 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,767 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,768 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,768 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 16:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e694e37[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-15 16:12:18,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e694e37[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:18,776 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-15 16:12:18,776 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,778 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,778 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:18,778 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:18,778 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:12:18,778 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,778 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:18,778 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:18,779 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:18,778 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. started... 2023-07-15 16:12:18,778 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-15 16:12:18,779 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 04d1251fcd3d5176eba48a3094f30436 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-15 16:12:18,779 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:18,779 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:18,779 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:18,779 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. started... 2023-07-15 16:12:18,779 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bf02f1efc4abd07d8af23807e6f9c8e9 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-15 16:12:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:18,781 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:18,823 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307157b1a2387c0a040a7892c1681d3a018f0 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307157b1a2387c0a040a7892c1681d3a018f0 2023-07-15 16:12:18,827 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071506799bc6667442a086f70eee74e68db6 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071506799bc6667442a086f70eee74e68db6 2023-07-15 16:12:18,836 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:18,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 16:12:18,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:18,837 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:18,841 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/.tmp/cf/45d6cacc24fc48c78c119a1d9473eb73 2023-07-15 16:12:18,849 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/.tmp/cf/45d6cacc24fc48c78c119a1d9473eb73 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/cf/45d6cacc24fc48c78c119a1d9473eb73 2023-07-15 16:12:18,850 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/.tmp/cf/4c1e5747b19740b8bf97543e0e1b911b 2023-07-15 16:12:18,856 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/cf/45d6cacc24fc48c78c119a1d9473eb73, entries=2, sequenceid=6, filesize=5.3 K 2023-07-15 16:12:18,857 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for bf02f1efc4abd07d8af23807e6f9c8e9 in 78ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:18,857 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-15 16:12:18,857 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bf02f1efc4abd07d8af23807e6f9c8e9: 2023-07-15 16:12:18,857 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,857 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:18,857 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/cf/45d6cacc24fc48c78c119a1d9473eb73] hfiles 2023-07-15 16:12:18,857 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/cf/45d6cacc24fc48c78c119a1d9473eb73 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,859 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/.tmp/cf/4c1e5747b19740b8bf97543e0e1b911b as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/cf/4c1e5747b19740b8bf97543e0e1b911b 2023-07-15 16:12:18,864 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/cf/4c1e5747b19740b8bf97543e0e1b911b, entries=48, sequenceid=6, filesize=13.7 K 2023-07-15 16:12:18,867 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 04d1251fcd3d5176eba48a3094f30436 in 88ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:18,869 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 04d1251fcd3d5176eba48a3094f30436: 2023-07-15 16:12:18,869 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,869 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:18,870 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/cf/4c1e5747b19740b8bf97543e0e1b911b] hfiles 2023-07-15 16:12:18,870 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/cf/4c1e5747b19740b8bf97543e0e1b911b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,929 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. completed. 2023-07-15 16:12:18,929 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. completed. 2023-07-15 16:12:18,929 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:18,929 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:12:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:12:18,932 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,932 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,932 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:18,932 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-15 16:12:18,932 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,932 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:18,932 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:18,933 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-15 16:12:18,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:12:18,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-15 16:12:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33799,1689437455269': 2023-07-15 16:12:18,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-15 16:12:18,941 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-15 16:12:18,941 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:18,941 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:18,941 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,941 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:18,946 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,946 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,946 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,946 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,946 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,946 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,946 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:18,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,947 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:18,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,947 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,948 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:18,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,949 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:18,950 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,950 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,953 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,953 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,953 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,953 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,953 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,953 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,953 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,954 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,954 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:18,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,954 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:18,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,954 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:18,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:18,954 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:18,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,955 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:18,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:12:18,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:18,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:18,956 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,956 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:18,956 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:18,956 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,956 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071506799bc6667442a086f70eee74e68db6, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307157b1a2387c0a040a7892c1681d3a018f0] mob files 2023-07-15 16:12:18,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071506799bc6667442a086f70eee74e68db6 2023-07-15 16:12:18,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307157b1a2387c0a040a7892c1681d3a018f0 2023-07-15 16:12:18,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:18,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:19,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-15 16:12:19,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:19,014 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:19,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689437538734Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689437538963 (+229 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689437538963Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689437538963Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689437538970 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689437538979 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689437539014 (+35 ms) 2023-07-15 16:12:19,017 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-15 16:12:19,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 282 msec 2023-07-15 16:12:19,038 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:19,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-15 16:12:19,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:19,070 DEBUG [Listener at jenkins-hbase4.apache.org/38899] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:12:19,076 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50744, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:12:19,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 16:12:19,079 DEBUG [Listener at jenkins-hbase4.apache.org/38899] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:12:19,082 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:12:19,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 16:12:19,082 DEBUG [Listener at jenkins-hbase4.apache.org/38899] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-15 16:12:19,085 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-15 16:12:19,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-15 16:12:19,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-15 16:12:19,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:19,092 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:12:19,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-15 16:12:19,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 16:12:19,093 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:12:19,096 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:19,096 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:19,097 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d empty. 2023-07-15 16:12:19,097 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094 empty. 2023-07-15 16:12:19,098 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:19,098 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:19,098 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 16:12:19,126 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-15 16:12:19,128 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5a7bf04fb0936a1a5057f16f5204731d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:12:19,130 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 51ddac18b0b5e68727d7d11733822094, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:12:19,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 16:12:19,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:19,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 51ddac18b0b5e68727d7d11733822094, disabling compactions & flushes 2023-07-15 16:12:19,201 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:19,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:19,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. after waiting 0 ms 2023-07-15 16:12:19,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:19,201 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:19,201 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 51ddac18b0b5e68727d7d11733822094: 2023-07-15 16:12:19,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 16:12:19,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:19,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 5a7bf04fb0936a1a5057f16f5204731d, disabling compactions & flushes 2023-07-15 16:12:19,594 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:19,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:19,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. after waiting 0 ms 2023-07-15 16:12:19,594 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:19,595 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:19,595 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 5a7bf04fb0936a1a5057f16f5204731d: 2023-07-15 16:12:19,597 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:12:19,598 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437539598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437539598"}]},"ts":"1689437539598"} 2023-07-15 16:12:19,598 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437539598"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437539598"}]},"ts":"1689437539598"} 2023-07-15 16:12:19,600 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:12:19,601 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:12:19,601 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437539601"}]},"ts":"1689437539601"} 2023-07-15 16:12:19,602 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-15 16:12:19,605 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:12:19,607 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:12:19,607 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:12:19,607 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:12:19,607 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:12:19,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5a7bf04fb0936a1a5057f16f5204731d, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=51ddac18b0b5e68727d7d11733822094, ASSIGN}] 2023-07-15 16:12:19,610 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=51ddac18b0b5e68727d7d11733822094, ASSIGN 2023-07-15 16:12:19,610 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5a7bf04fb0936a1a5057f16f5204731d, ASSIGN 2023-07-15 16:12:19,610 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=51ddac18b0b5e68727d7d11733822094, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1689437455210; forceNewPlan=false, retain=false 2023-07-15 16:12:19,610 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5a7bf04fb0936a1a5057f16f5204731d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33799,1689437455269; forceNewPlan=false, retain=false 2023-07-15 16:12:19,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 16:12:19,761 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:12:19,764 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=51ddac18b0b5e68727d7d11733822094, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:19,764 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5a7bf04fb0936a1a5057f16f5204731d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:19,765 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437539764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437539764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437539764"}]},"ts":"1689437539764"} 2023-07-15 16:12:19,765 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437539764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437539764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437539764"}]},"ts":"1689437539764"} 2023-07-15 16:12:19,768 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 51ddac18b0b5e68727d7d11733822094, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:12:19,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 5a7bf04fb0936a1a5057f16f5204731d, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:12:19,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:19,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 51ddac18b0b5e68727d7d11733822094, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.', STARTKEY => '2', ENDKEY => ''} 2023-07-15 16:12:19,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. service=AccessControlService 2023-07-15 16:12:19,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:19,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:19,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:19,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:19,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:19,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:19,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a7bf04fb0936a1a5057f16f5204731d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.', STARTKEY => '', ENDKEY => '2'} 2023-07-15 16:12:19,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. service=AccessControlService 2023-07-15 16:12:19,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:19,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:19,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:19,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:19,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:19,929 INFO [StoreOpener-51ddac18b0b5e68727d7d11733822094-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:19,929 INFO [StoreOpener-5a7bf04fb0936a1a5057f16f5204731d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:19,931 DEBUG [StoreOpener-51ddac18b0b5e68727d7d11733822094-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/cf 2023-07-15 16:12:19,931 DEBUG [StoreOpener-51ddac18b0b5e68727d7d11733822094-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/cf 2023-07-15 16:12:19,932 INFO [StoreOpener-51ddac18b0b5e68727d7d11733822094-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 51ddac18b0b5e68727d7d11733822094 columnFamilyName cf 2023-07-15 16:12:19,932 DEBUG [StoreOpener-5a7bf04fb0936a1a5057f16f5204731d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/cf 2023-07-15 16:12:19,932 DEBUG [StoreOpener-5a7bf04fb0936a1a5057f16f5204731d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/cf 2023-07-15 16:12:19,932 INFO [StoreOpener-5a7bf04fb0936a1a5057f16f5204731d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a7bf04fb0936a1a5057f16f5204731d columnFamilyName cf 2023-07-15 16:12:19,932 INFO [StoreOpener-51ddac18b0b5e68727d7d11733822094-1] regionserver.HStore(310): Store=51ddac18b0b5e68727d7d11733822094/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:19,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:19,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:19,940 INFO [StoreOpener-5a7bf04fb0936a1a5057f16f5204731d-1] regionserver.HStore(310): Store=5a7bf04fb0936a1a5057f16f5204731d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:19,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:19,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:19,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:19,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:19,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:19,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:19,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 51ddac18b0b5e68727d7d11733822094; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64885791, jitterRate=-0.03312636911869049}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:19,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 51ddac18b0b5e68727d7d11733822094: 2023-07-15 16:12:19,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5a7bf04fb0936a1a5057f16f5204731d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75237654, jitterRate=0.12112841010093689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:19,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5a7bf04fb0936a1a5057f16f5204731d: 2023-07-15 16:12:19,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094., pid=69, masterSystemTime=1689437539920 2023-07-15 16:12:19,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d., pid=70, masterSystemTime=1689437539920 2023-07-15 16:12:19,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:19,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:19,964 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=51ddac18b0b5e68727d7d11733822094, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:19,964 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437539964"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437539964"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437539964"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437539964"}]},"ts":"1689437539964"} 2023-07-15 16:12:19,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:19,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:19,967 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5a7bf04fb0936a1a5057f16f5204731d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:19,967 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437539967"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437539967"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437539967"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437539967"}]},"ts":"1689437539967"} 2023-07-15 16:12:19,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-15 16:12:19,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 51ddac18b0b5e68727d7d11733822094, server=jenkins-hbase4.apache.org,46287,1689437455210 in 198 msec 2023-07-15 16:12:19,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=51ddac18b0b5e68727d7d11733822094, ASSIGN in 361 msec 2023-07-15 16:12:19,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-15 16:12:19,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 5a7bf04fb0936a1a5057f16f5204731d, server=jenkins-hbase4.apache.org,33799,1689437455269 in 201 msec 2023-07-15 16:12:19,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-15 16:12:19,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5a7bf04fb0936a1a5057f16f5204731d, ASSIGN in 364 msec 2023-07-15 16:12:19,976 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:12:19,976 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437539976"}]},"ts":"1689437539976"} 2023-07-15 16:12:19,977 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-15 16:12:19,980 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:12:19,981 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-15 16:12:19,983 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 16:12:19,985 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:19,985 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:19,985 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:19,985 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:19,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:19,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:19,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:19,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:19,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:19,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:19,988 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:19,989 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:19,989 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 899 msec 2023-07-15 16:12:20,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-15 16:12:20,199 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-15 16:12:20,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 5a7bf04fb0936a1a5057f16f5204731d, 51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:20,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5a7bf04fb0936a1a5057f16f5204731d, 51ddac18b0b5e68727d7d11733822094], force=true 2023-07-15 16:12:20,244 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5a7bf04fb0936a1a5057f16f5204731d, 51ddac18b0b5e68727d7d11733822094], force=true 2023-07-15 16:12:20,244 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5a7bf04fb0936a1a5057f16f5204731d, 51ddac18b0b5e68727d7d11733822094], force=true 2023-07-15 16:12:20,244 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5a7bf04fb0936a1a5057f16f5204731d, 51ddac18b0b5e68727d7d11733822094], force=true 2023-07-15 16:12:20,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:20,278 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5a7bf04fb0936a1a5057f16f5204731d, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=51ddac18b0b5e68727d7d11733822094, UNASSIGN}] 2023-07-15 16:12:20,281 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5a7bf04fb0936a1a5057f16f5204731d, UNASSIGN 2023-07-15 16:12:20,281 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=51ddac18b0b5e68727d7d11733822094, UNASSIGN 2023-07-15 16:12:20,283 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5a7bf04fb0936a1a5057f16f5204731d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:20,283 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=51ddac18b0b5e68727d7d11733822094, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:20,283 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437540283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437540283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437540283"}]},"ts":"1689437540283"} 2023-07-15 16:12:20,283 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437540283"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437540283"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437540283"}]},"ts":"1689437540283"} 2023-07-15 16:12:20,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 5a7bf04fb0936a1a5057f16f5204731d, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:12:20,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 51ddac18b0b5e68727d7d11733822094, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:12:20,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:20,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:20,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:20,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 51ddac18b0b5e68727d7d11733822094, disabling compactions & flushes 2023-07-15 16:12:20,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5a7bf04fb0936a1a5057f16f5204731d, disabling compactions & flushes 2023-07-15 16:12:20,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:20,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:20,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:20,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:20,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. after waiting 0 ms 2023-07-15 16:12:20,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:20,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. after waiting 0 ms 2023-07-15 16:12:20,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:20,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 51ddac18b0b5e68727d7d11733822094 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 16:12:20,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5a7bf04fb0936a1a5057f16f5204731d 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-15 16:12:20,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/.tmp/cf/589c928fedd645279abe2fdfbffc9f71 2023-07-15 16:12:20,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/.tmp/cf/bb5cca9d55104031bc916592ecb7aae9 2023-07-15 16:12:20,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/.tmp/cf/589c928fedd645279abe2fdfbffc9f71 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/cf/589c928fedd645279abe2fdfbffc9f71 2023-07-15 16:12:20,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/.tmp/cf/bb5cca9d55104031bc916592ecb7aae9 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/cf/bb5cca9d55104031bc916592ecb7aae9 2023-07-15 16:12:20,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/cf/bb5cca9d55104031bc916592ecb7aae9, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 16:12:20,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/cf/589c928fedd645279abe2fdfbffc9f71, entries=1, sequenceid=5, filesize=4.7 K 2023-07-15 16:12:20,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5a7bf04fb0936a1a5057f16f5204731d in 52ms, sequenceid=5, compaction requested=false 2023-07-15 16:12:20,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 51ddac18b0b5e68727d7d11733822094 in 52ms, sequenceid=5, compaction requested=false 2023-07-15 16:12:20,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 16:12:20,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 16:12:20,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 16:12:20,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:20,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d. 2023-07-15 16:12:20,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5a7bf04fb0936a1a5057f16f5204731d: 2023-07-15 16:12:20,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-15 16:12:20,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:20,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094. 2023-07-15 16:12:20,528 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 51ddac18b0b5e68727d7d11733822094: 2023-07-15 16:12:20,528 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:20,528 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5a7bf04fb0936a1a5057f16f5204731d, regionState=CLOSED 2023-07-15 16:12:20,529 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437540528"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437540528"}]},"ts":"1689437540528"} 2023-07-15 16:12:20,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:20,530 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=51ddac18b0b5e68727d7d11733822094, regionState=CLOSED 2023-07-15 16:12:20,530 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689437540530"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437540530"}]},"ts":"1689437540530"} 2023-07-15 16:12:20,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-15 16:12:20,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-15 16:12:20,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 5a7bf04fb0936a1a5057f16f5204731d, server=jenkins-hbase4.apache.org,33799,1689437455269 in 246 msec 2023-07-15 16:12:20,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 51ddac18b0b5e68727d7d11733822094, server=jenkins-hbase4.apache.org,46287,1689437455210 in 246 msec 2023-07-15 16:12:20,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5a7bf04fb0936a1a5057f16f5204731d, UNASSIGN in 263 msec 2023-07-15 16:12:20,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-15 16:12:20,539 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=51ddac18b0b5e68727d7d11733822094, UNASSIGN in 259 msec 2023-07-15 16:12:20,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:20,626 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-15 16:12:20,634 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539087.5a7bf04fb0936a1a5057f16f5204731d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:20,634 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689437539087.51ddac18b0b5e68727d7d11733822094.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:20,635 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:20,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b4f051dad4d30ded14b759a3be97567, ASSIGN}] 2023-07-15 16:12:20,704 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b4f051dad4d30ded14b759a3be97567, ASSIGN 2023-07-15 16:12:20,705 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b4f051dad4d30ded14b759a3be97567, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33799,1689437455269; forceNewPlan=false, retain=false 2023-07-15 16:12:20,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:20,856 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-15 16:12:20,858 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5b4f051dad4d30ded14b759a3be97567, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:20,858 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689437540858"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437540858"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437540858"}]},"ts":"1689437540858"} 2023-07-15 16:12:20,865 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 5b4f051dad4d30ded14b759a3be97567, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:12:21,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. 2023-07-15 16:12:21,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b4f051dad4d30ded14b759a3be97567, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.', STARTKEY => '', ENDKEY => ''} 2023-07-15 16:12:21,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. service=AccessControlService 2023-07-15 16:12:21,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:21,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:21,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:21,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:21,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:21,024 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/.regioninfo 2023-07-15 16:12:21,053 INFO [StoreOpener-5b4f051dad4d30ded14b759a3be97567-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:21,054 DEBUG [StoreOpener-5b4f051dad4d30ded14b759a3be97567-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf 2023-07-15 16:12:21,054 DEBUG [StoreOpener-5b4f051dad4d30ded14b759a3be97567-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf 2023-07-15 16:12:21,055 INFO [StoreOpener-5b4f051dad4d30ded14b759a3be97567-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b4f051dad4d30ded14b759a3be97567 columnFamilyName cf 2023-07-15 16:12:21,091 DEBUG [StoreOpener-5b4f051dad4d30ded14b759a3be97567-1] regionserver.HStore(539): loaded hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/589c928fedd645279abe2fdfbffc9f71.5a7bf04fb0936a1a5057f16f5204731d->hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/cf/589c928fedd645279abe2fdfbffc9f71-top 2023-07-15 16:12:21,098 DEBUG [StoreOpener-5b4f051dad4d30ded14b759a3be97567-1] regionserver.HStore(539): loaded hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/bb5cca9d55104031bc916592ecb7aae9.51ddac18b0b5e68727d7d11733822094->hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/cf/bb5cca9d55104031bc916592ecb7aae9-top 2023-07-15 16:12:21,099 INFO [StoreOpener-5b4f051dad4d30ded14b759a3be97567-1] regionserver.HStore(310): Store=5b4f051dad4d30ded14b759a3be97567/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:21,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:21,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:21,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:21,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b4f051dad4d30ded14b759a3be97567; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61688721, jitterRate=-0.08076642453670502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:21,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b4f051dad4d30ded14b759a3be97567: 2023-07-15 16:12:21,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567., pid=77, masterSystemTime=1689437541018 2023-07-15 16:12:21,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.,because compaction is disabled. 2023-07-15 16:12:21,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. 2023-07-15 16:12:21,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. 2023-07-15 16:12:21,110 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=5b4f051dad4d30ded14b759a3be97567, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:21,110 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689437541110"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437541110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437541110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437541110"}]},"ts":"1689437541110"} 2023-07-15 16:12:21,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-15 16:12:21,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 5b4f051dad4d30ded14b759a3be97567, server=jenkins-hbase4.apache.org,33799,1689437455269 in 247 msec 2023-07-15 16:12:21,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-15 16:12:21,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b4f051dad4d30ded14b759a3be97567, ASSIGN in 411 msec 2023-07-15 16:12:21,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5a7bf04fb0936a1a5057f16f5204731d, 51ddac18b0b5e68727d7d11733822094], force=true in 884 msec 2023-07-15 16:12:21,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-15 16:12:21,354 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-15 16:12:21,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 16:12:21,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437541355 (current time:1689437541355). 2023-07-15 16:12:21,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:21,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x0e7b31c4 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:21,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2699b19a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:21,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:21,377 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:21,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e7b31c4 to 127.0.0.1:62768 2023-07-15 16:12:21,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:21,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x3f578086 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:21,445 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0004_000001 (auth:SIMPLE) 2023-07-15 16:12:21,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68f573b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:21,472 DEBUG [hconnection-0x38b1a5c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:21,476 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:21,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:21,484 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:21,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f578086 to 127.0.0.1:62768 2023-07-15 16:12:21,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:21,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-15 16:12:21,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:21,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 16:12:21,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 16:12:21,490 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 16:12:21,490 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689438141490 2023-07-15 16:12:21,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-15 16:12:21,495 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:21,495 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:21,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 16:12:21,496 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-15 16:12:21,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-15 16:12:21,498 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 16:12:21,498 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689438141498 2023-07-15 16:12:21,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,513 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-15 16:12:21,513 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:21,515 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-15 16:12:21,515 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-15 16:12:21,595 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:21,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 16:12:21,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:21,599 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:21,602 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,602 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,604 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:21,604 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:21,604 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:21,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:21,604 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:21,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:21,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:21,604 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:21,604 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,605 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 16:12:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 16:12:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 16:12:21,606 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 16:12:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-15 16:12:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,607 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-15 16:12:21,610 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,611 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 16:12:21,611 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:21,636 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 16:12:21,636 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 16:12:21,636 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 16:12:21,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,639 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,640 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,640 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:21,640 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 16:12:21,640 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:21,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,642 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 16:12:21,642 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 16:12:21,642 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-15 16:12:21,643 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:21,642 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 16:12:21,646 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-15 16:12:21,646 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-15 16:12:21,646 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-15 16:12:21,648 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:21,648 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:21,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:21,649 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,649 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:21,649 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,649 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,650 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:21,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:21,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:21,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:21,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:21,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:21,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:21,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-15 16:12:21,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5109fa94[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:21,654 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-15 16:12:21,655 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,656 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,656 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,656 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,656 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 16:12:21,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 16:12:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 16:12:21,657 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:21,657 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:21,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:12:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-15 16:12:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 16:12:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:12:21,659 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:21,659 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:21,659 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. 2023-07-15 16:12:21,659 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. started... 2023-07-15 16:12:21,662 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b4f051dad4d30ded14b759a3be97567: 2023-07-15 16:12:21,662 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 16:12:21,662 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:21,662 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 16:12:21,664 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 16:12:21,665 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:21,665 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 16:12:21,671 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,675 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:21,675 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/589c928fedd645279abe2fdfbffc9f71.5a7bf04fb0936a1a5057f16f5204731d->hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/cf/589c928fedd645279abe2fdfbffc9f71-top, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/bb5cca9d55104031bc916592ecb7aae9.51ddac18b0b5e68727d7d11733822094->hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/cf/bb5cca9d55104031bc916592ecb7aae9-top] hfiles 2023-07-15 16:12:21,675 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/589c928fedd645279abe2fdfbffc9f71.5a7bf04fb0936a1a5057f16f5204731d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,676 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/bb5cca9d55104031bc916592ecb7aae9.51ddac18b0b5e68727d7d11733822094 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:21,800 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:21,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 16:12:21,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:21,802 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:12:22,103 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:22,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 16:12:22,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:22,105 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 16:12:22,108 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. completed. 2023-07-15 16:12:22,108 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. 2023-07-15 16:12:22,109 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:22,109 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:22,109 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,109 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-15 16:12:22,109 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:12:22,119 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:22,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:22,119 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-15 16:12:22,120 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:22,120 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-15 16:12:22,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:22,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:22,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:22,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:22,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:22,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33799,1689437455269': 2023-07-15 16:12:22,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-15 16:12:22,126 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-15 16:12:22,126 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:22,126 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:22,126 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,126 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:22,128 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,128 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,128 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,128 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:22,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,128 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:22,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:22,128 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:22,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:22,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:22,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,128 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:22,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,129 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:22,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:22,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:22,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:22,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:22,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:22,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,130 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:22,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,131 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:22,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,133 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:22,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:22,133 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:22,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,134 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:22,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:22,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,137 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:22,137 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:22,137 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:22,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:22,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:22,137 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:22,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:22,137 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:22,137 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:22,137 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:22,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:22,137 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:22,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:22,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,138 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:22,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:22,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:22,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:22,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:22,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:22,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,278 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-15 16:12:22,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,279 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689437541490Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689437542138 (+648 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689437542138Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689437542143 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689437542174 (+31 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689437542278 (+104 ms) 2023-07-15 16:12:22,282 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-15 16:12:22,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 789 msec 2023-07-15 16:12:22,605 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:22,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-15 16:12:22,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:22,607 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606 2023-07-15 16:12:22,607 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34451, tgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606, rawTgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606, srcFsUri=hdfs://localhost:34451, srcDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:12:22,643 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:12:22,643 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1113832357_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,643 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9, snapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-15 16:12:22,668 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:22,751 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:22,752 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:22,753 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:22,753 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:22,982 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:12:23,911 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-3349153154558922490.jar 2023-07-15 16:12:23,911 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:23,912 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:23,996 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-6873958163082285916.jar 2023-07-15 16:12:23,997 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:23,997 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:23,998 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:23,998 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:23,999 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:23,999 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:24,000 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:12:24,001 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:12:24,001 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:12:24,002 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:12:24,002 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:12:24,003 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:12:24,004 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:12:24,004 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:12:24,005 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:12:24,005 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:12:24,006 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:24,007 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:24,008 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:24,008 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:24,008 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:24,009 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:24,010 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:25,904 WARN [Listener at jenkins-hbase4.apache.org/38899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:12:25,907 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-15 16:12:25,910 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-15 16:12:26,049 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:26,049 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:26,466 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:32,870 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:35,142 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:38,412 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:40,256 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:12:40,263 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:12:40,278 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,279 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:12:40,279 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:12:40,279 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,280 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 16:12:40,280 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 16:12:40,280 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,281 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-15 16:12:40,281 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437542606/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-15 16:12:40,290 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 16:12:40,308 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437560308"}]},"ts":"1689437560308"} 2023-07-15 16:12:40,309 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-15 16:12:40,311 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-15 16:12:40,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b4f051dad4d30ded14b759a3be97567, UNASSIGN}] 2023-07-15 16:12:40,312 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b4f051dad4d30ded14b759a3be97567, UNASSIGN 2023-07-15 16:12:40,313 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=5b4f051dad4d30ded14b759a3be97567, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:40,313 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689437560313"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437560313"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437560313"}]},"ts":"1689437560313"} 2023-07-15 16:12:40,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 5b4f051dad4d30ded14b759a3be97567, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:12:40,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 16:12:40,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:40,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b4f051dad4d30ded14b759a3be97567, disabling compactions & flushes 2023-07-15 16:12:40,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. 2023-07-15 16:12:40,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. 2023-07-15 16:12:40,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. after waiting 0 ms 2023-07-15 16:12:40,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. 2023-07-15 16:12:40,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-15 16:12:40,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:40,486 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567. 2023-07-15 16:12:40,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b4f051dad4d30ded14b759a3be97567: 2023-07-15 16:12:40,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:40,489 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=5b4f051dad4d30ded14b759a3be97567, regionState=CLOSED 2023-07-15 16:12:40,489 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689437560489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437560489"}]},"ts":"1689437560489"} 2023-07-15 16:12:40,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-15 16:12:40,493 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 5b4f051dad4d30ded14b759a3be97567, server=jenkins-hbase4.apache.org,33799,1689437455269 in 176 msec 2023-07-15 16:12:40,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-15 16:12:40,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5b4f051dad4d30ded14b759a3be97567, UNASSIGN in 180 msec 2023-07-15 16:12:40,495 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437560495"}]},"ts":"1689437560495"} 2023-07-15 16:12:40,496 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-15 16:12:40,497 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-15 16:12:40,500 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 208 msec 2023-07-15 16:12:40,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-15 16:12:40,604 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-15 16:12:40,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,613 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,615 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,619 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,623 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:40,623 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:40,624 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,624 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,624 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,624 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,625 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/recovered.edits] 2023-07-15 16:12:40,627 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/recovered.edits] 2023-07-15 16:12:40,630 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:40,630 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:40,630 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:40,630 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:40,630 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:40,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-15 16:12:40,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-15 16:12:40,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-15 16:12:40,631 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-15 16:12:40,631 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 16:12:40,631 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 16:12:40,631 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 16:12:40,631 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 16:12:40,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 16:12:40,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:40,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:40,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:40,632 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:40,635 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/recovered.edits] 2023-07-15 16:12:40,636 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/cf/bb5cca9d55104031bc916592ecb7aae9 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/cf/bb5cca9d55104031bc916592ecb7aae9 2023-07-15 16:12:40,640 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/recovered.edits/8.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094/recovered.edits/8.seqid 2023-07-15 16:12:40,640 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/cf/589c928fedd645279abe2fdfbffc9f71 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/cf/589c928fedd645279abe2fdfbffc9f71 2023-07-15 16:12:40,640 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:40,642 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/589c928fedd645279abe2fdfbffc9f71.5a7bf04fb0936a1a5057f16f5204731d to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/589c928fedd645279abe2fdfbffc9f71.5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:40,644 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/bb5cca9d55104031bc916592ecb7aae9.51ddac18b0b5e68727d7d11733822094 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/cf/bb5cca9d55104031bc916592ecb7aae9.51ddac18b0b5e68727d7d11733822094 2023-07-15 16:12:40,644 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/recovered.edits/8.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d/recovered.edits/8.seqid 2023-07-15 16:12:40,645 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5a7bf04fb0936a1a5057f16f5204731d 2023-07-15 16:12:40,656 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/recovered.edits/12.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567/recovered.edits/12.seqid 2023-07-15 16:12:40,657 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5b4f051dad4d30ded14b759a3be97567 2023-07-15 16:12:40,657 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-15 16:12:40,661 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,673 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-15 16:12:40,675 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-15 16:12:40,676 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,677 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-15 16:12:40,677 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437560677"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:40,683 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-15 16:12:40,684 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b4f051dad4d30ded14b759a3be97567, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689437539088.5b4f051dad4d30ded14b759a3be97567.', STARTKEY => '', ENDKEY => ''}] 2023-07-15 16:12:40,684 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-15 16:12:40,684 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437560684"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:40,689 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-15 16:12:40,697 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:40,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 91 msec 2023-07-15 16:12:40,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-15 16:12:40,733 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-15 16:12:40,734 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:40,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:40,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:40,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 16:12:40,752 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437560752"}]},"ts":"1689437560752"} 2023-07-15 16:12:40,754 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-15 16:12:40,757 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-15 16:12:40,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bf02f1efc4abd07d8af23807e6f9c8e9, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04d1251fcd3d5176eba48a3094f30436, UNASSIGN}] 2023-07-15 16:12:40,765 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bf02f1efc4abd07d8af23807e6f9c8e9, UNASSIGN 2023-07-15 16:12:40,765 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04d1251fcd3d5176eba48a3094f30436, UNASSIGN 2023-07-15 16:12:40,766 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=04d1251fcd3d5176eba48a3094f30436, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:40,766 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bf02f1efc4abd07d8af23807e6f9c8e9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:40,766 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437560766"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437560766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437560766"}]},"ts":"1689437560766"} 2023-07-15 16:12:40,766 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437560766"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437560766"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437560766"}]},"ts":"1689437560766"} 2023-07-15 16:12:40,769 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 04d1251fcd3d5176eba48a3094f30436, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:12:40,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure bf02f1efc4abd07d8af23807e6f9c8e9, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:12:40,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 16:12:40,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:40,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bf02f1efc4abd07d8af23807e6f9c8e9, disabling compactions & flushes 2023-07-15 16:12:40,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:40,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:40,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. after waiting 0 ms 2023-07-15 16:12:40,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:40,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:40,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 04d1251fcd3d5176eba48a3094f30436, disabling compactions & flushes 2023-07-15 16:12:40,931 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:40,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:40,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. after waiting 0 ms 2023-07-15 16:12:40,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:40,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:40,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:40,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:40,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:40,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9. 2023-07-15 16:12:40,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436. 2023-07-15 16:12:40,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bf02f1efc4abd07d8af23807e6f9c8e9: 2023-07-15 16:12:40,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 04d1251fcd3d5176eba48a3094f30436: 2023-07-15 16:12:40,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:40,974 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=04d1251fcd3d5176eba48a3094f30436, regionState=CLOSED 2023-07-15 16:12:40,974 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437560974"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437560974"}]},"ts":"1689437560974"} 2023-07-15 16:12:40,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:40,975 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=bf02f1efc4abd07d8af23807e6f9c8e9, regionState=CLOSED 2023-07-15 16:12:40,975 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689437560975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437560975"}]},"ts":"1689437560975"} 2023-07-15 16:12:40,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-15 16:12:40,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 04d1251fcd3d5176eba48a3094f30436, server=jenkins-hbase4.apache.org,46287,1689437455210 in 207 msec 2023-07-15 16:12:40,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-15 16:12:40,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure bf02f1efc4abd07d8af23807e6f9c8e9, server=jenkins-hbase4.apache.org,33799,1689437455269 in 207 msec 2023-07-15 16:12:40,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=04d1251fcd3d5176eba48a3094f30436, UNASSIGN in 216 msec 2023-07-15 16:12:40,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-15 16:12:40,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=bf02f1efc4abd07d8af23807e6f9c8e9, UNASSIGN in 218 msec 2023-07-15 16:12:40,982 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437560982"}]},"ts":"1689437560982"} 2023-07-15 16:12:40,985 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-15 16:12:40,988 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-15 16:12:40,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 253 msec 2023-07-15 16:12:41,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-15 16:12:41,055 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-15 16:12:41,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,064 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,065 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,066 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,069 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,069 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,069 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,069 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 16:12:41,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 16:12:41,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-15 16:12:41,072 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,072 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:41,072 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,072 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:41,072 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,072 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:41,072 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:41,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 16:12:41,073 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-15 16:12:41,073 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-15 16:12:41,073 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:41,073 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:41,075 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/recovered.edits] 2023-07-15 16:12:41,075 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/recovered.edits] 2023-07-15 16:12:41,081 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/cf/4c1e5747b19740b8bf97543e0e1b911b to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/cf/4c1e5747b19740b8bf97543e0e1b911b 2023-07-15 16:12:41,082 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/cf/45d6cacc24fc48c78c119a1d9473eb73 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/cf/45d6cacc24fc48c78c119a1d9473eb73 2023-07-15 16:12:41,086 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436/recovered.edits/9.seqid 2023-07-15 16:12:41,086 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9/recovered.edits/9.seqid 2023-07-15 16:12:41,087 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/04d1251fcd3d5176eba48a3094f30436 2023-07-15 16:12:41,087 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/bf02f1efc4abd07d8af23807e6f9c8e9 2023-07-15 16:12:41,087 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-15 16:12:41,088 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-15 16:12:41,088 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-15 16:12:41,092 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071506799bc6667442a086f70eee74e68db6 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023071506799bc6667442a086f70eee74e68db6 2023-07-15 16:12:41,094 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307157b1a2387c0a040a7892c1681d3a018f0 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307157b1a2387c0a040a7892c1681d3a018f0 2023-07-15 16:12:41,094 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-15 16:12:41,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,100 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-15 16:12:41,103 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-15 16:12:41,104 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,104 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-15 16:12:41,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437561104"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:41,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437561104"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:41,107 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:12:41,107 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bf02f1efc4abd07d8af23807e6f9c8e9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689437537682.bf02f1efc4abd07d8af23807e6f9c8e9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 04d1251fcd3d5176eba48a3094f30436, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689437537682.04d1251fcd3d5176eba48a3094f30436.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:12:41,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-15 16:12:41,108 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437561108"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:41,111 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-15 16:12:41,114 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 58 msec 2023-07-15 16:12:41,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-15 16:12:41,174 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-15 16:12:41,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 16:12:41,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-15 16:12:41,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-15 16:12:41,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-15 16:12:41,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-15 16:12:41,237 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 745) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:54786 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:36504 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:57014 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_822452844_1 at /127.0.0.1:36478 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_822452844_1 at /127.0.0.1:42540 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:43479 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4108 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:59880 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 895) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=620 (was 562) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 185), AvailableMemoryMB=2475 (was 2628) 2023-07-15 16:12:41,238 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-15 16:12:41,266 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=620, ProcessCount=181, AvailableMemoryMB=2473 2023-07-15 16:12:41,266 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-15 16:12:41,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 16:12:41,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:41,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:12:41,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-15 16:12:41,275 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:12:41,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 16:12:41,286 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:41,286 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:41,287 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538 empty. 2023-07-15 16:12:41,287 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97 empty. 2023-07-15 16:12:41,289 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:41,289 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:41,289 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 16:12:41,359 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-15 16:12:41,372 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => dc40cd95f7ecc77009aeec3325906538, NAME => 'testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:12:41,373 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 98ffb5bd5824bd7695f57cad6d6c9b97, NAME => 'testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:12:41,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 16:12:41,419 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:41,419 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 98ffb5bd5824bd7695f57cad6d6c9b97, disabling compactions & flushes 2023-07-15 16:12:41,419 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:41,420 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:41,420 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. after waiting 0 ms 2023-07-15 16:12:41,420 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:41,420 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:41,420 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 98ffb5bd5824bd7695f57cad6d6c9b97: 2023-07-15 16:12:41,440 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:41,440 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing dc40cd95f7ecc77009aeec3325906538, disabling compactions & flushes 2023-07-15 16:12:41,440 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:41,440 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:41,440 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. after waiting 0 ms 2023-07-15 16:12:41,440 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:41,440 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:41,440 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for dc40cd95f7ecc77009aeec3325906538: 2023-07-15 16:12:41,454 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:12:41,455 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437561455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437561455"}]},"ts":"1689437561455"} 2023-07-15 16:12:41,455 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437561455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437561455"}]},"ts":"1689437561455"} 2023-07-15 16:12:41,460 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:12:41,461 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:12:41,461 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437561461"}]},"ts":"1689437561461"} 2023-07-15 16:12:41,462 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-15 16:12:41,466 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:12:41,468 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:12:41,468 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:12:41,468 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:12:41,468 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:12:41,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=98ffb5bd5824bd7695f57cad6d6c9b97, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc40cd95f7ecc77009aeec3325906538, ASSIGN}] 2023-07-15 16:12:41,471 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc40cd95f7ecc77009aeec3325906538, ASSIGN 2023-07-15 16:12:41,471 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=98ffb5bd5824bd7695f57cad6d6c9b97, ASSIGN 2023-07-15 16:12:41,474 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc40cd95f7ecc77009aeec3325906538, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33799,1689437455269; forceNewPlan=false, retain=false 2023-07-15 16:12:41,474 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=98ffb5bd5824bd7695f57cad6d6c9b97, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1689437455210; forceNewPlan=false, retain=false 2023-07-15 16:12:41,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 16:12:41,624 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:12:41,628 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=98ffb5bd5824bd7695f57cad6d6c9b97, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:41,628 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437561628"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437561628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437561628"}]},"ts":"1689437561628"} 2023-07-15 16:12:41,628 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=dc40cd95f7ecc77009aeec3325906538, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:41,629 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437561628"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437561628"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437561628"}]},"ts":"1689437561628"} 2023-07-15 16:12:41,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 98ffb5bd5824bd7695f57cad6d6c9b97, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:12:41,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure dc40cd95f7ecc77009aeec3325906538, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:12:41,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:41,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc40cd95f7ecc77009aeec3325906538, NAME => 'testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:12:41,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. service=AccessControlService 2023-07-15 16:12:41,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:41,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:41,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:41,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:41,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:41,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:41,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98ffb5bd5824bd7695f57cad6d6c9b97, NAME => 'testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:12:41,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. service=AccessControlService 2023-07-15 16:12:41,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:41,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:41,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:41,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:41,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:41,802 INFO [StoreOpener-dc40cd95f7ecc77009aeec3325906538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:41,804 DEBUG [StoreOpener-dc40cd95f7ecc77009aeec3325906538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/cf 2023-07-15 16:12:41,804 DEBUG [StoreOpener-dc40cd95f7ecc77009aeec3325906538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/cf 2023-07-15 16:12:41,804 INFO [StoreOpener-98ffb5bd5824bd7695f57cad6d6c9b97-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:41,805 INFO [StoreOpener-dc40cd95f7ecc77009aeec3325906538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc40cd95f7ecc77009aeec3325906538 columnFamilyName cf 2023-07-15 16:12:41,807 DEBUG [StoreOpener-98ffb5bd5824bd7695f57cad6d6c9b97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/cf 2023-07-15 16:12:41,807 DEBUG [StoreOpener-98ffb5bd5824bd7695f57cad6d6c9b97-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/cf 2023-07-15 16:12:41,807 INFO [StoreOpener-98ffb5bd5824bd7695f57cad6d6c9b97-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98ffb5bd5824bd7695f57cad6d6c9b97 columnFamilyName cf 2023-07-15 16:12:41,807 INFO [StoreOpener-dc40cd95f7ecc77009aeec3325906538-1] regionserver.HStore(310): Store=dc40cd95f7ecc77009aeec3325906538/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:41,808 INFO [StoreOpener-98ffb5bd5824bd7695f57cad6d6c9b97-1] regionserver.HStore(310): Store=98ffb5bd5824bd7695f57cad6d6c9b97/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:41,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:41,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:41,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:41,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:41,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:41,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:41,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:41,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:41,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc40cd95f7ecc77009aeec3325906538; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62730895, jitterRate=-0.06523682177066803}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:41,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc40cd95f7ecc77009aeec3325906538: 2023-07-15 16:12:41,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 98ffb5bd5824bd7695f57cad6d6c9b97; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71712956, jitterRate=0.06860631704330444}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:41,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 98ffb5bd5824bd7695f57cad6d6c9b97: 2023-07-15 16:12:41,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538., pid=94, masterSystemTime=1689437561790 2023-07-15 16:12:41,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97., pid=93, masterSystemTime=1689437561789 2023-07-15 16:12:41,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:41,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:41,822 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=dc40cd95f7ecc77009aeec3325906538, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:41,822 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437561822"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437561822"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437561822"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437561822"}]},"ts":"1689437561822"} 2023-07-15 16:12:41,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:41,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:41,823 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=98ffb5bd5824bd7695f57cad6d6c9b97, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:41,823 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437561823"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437561823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437561823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437561823"}]},"ts":"1689437561823"} 2023-07-15 16:12:41,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-15 16:12:41,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure dc40cd95f7ecc77009aeec3325906538, server=jenkins-hbase4.apache.org,33799,1689437455269 in 192 msec 2023-07-15 16:12:41,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-15 16:12:41,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc40cd95f7ecc77009aeec3325906538, ASSIGN in 359 msec 2023-07-15 16:12:41,829 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 98ffb5bd5824bd7695f57cad6d6c9b97, server=jenkins-hbase4.apache.org,46287,1689437455210 in 194 msec 2023-07-15 16:12:41,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-15 16:12:41,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=98ffb5bd5824bd7695f57cad6d6c9b97, ASSIGN in 361 msec 2023-07-15 16:12:41,831 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:12:41,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437561831"}]},"ts":"1689437561831"} 2023-07-15 16:12:41,832 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-15 16:12:41,836 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:12:41,836 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-15 16:12:41,838 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:12:41,839 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:41,839 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:41,840 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:41,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:41,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:41,841 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:41,842 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:41,843 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:41,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 572 msec 2023-07-15 16:12:41,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-15 16:12:41,887 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-15 16:12:41,899 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:41,900 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:41,902 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:41,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:41,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437561936 (current time:1689437561936). 2023-07-15 16:12:41,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:41,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x4a08b115 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:41,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@122cba8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:41,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:41,953 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:41,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a08b115 to 127.0.0.1:62768 2023-07-15 16:12:41,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:41,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x21b890a9 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:41,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eb71d92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:41,964 DEBUG [hconnection-0x59b83a12-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:41,967 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:41,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:41,974 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:41,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21b890a9 to 127.0.0.1:62768 2023-07-15 16:12:41,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:41,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:12:41,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:41,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:41,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:41,979 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:41,980 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689438161980 2023-07-15 16:12:41,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:41,980 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:41,981 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:41,981 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:41,982 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:41,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:41,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-15 16:12:41,986 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:41,987 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689438161987 2023-07-15 16:12:41,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:41,998 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-15 16:12:41,998 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:41,999 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 16:12:42,000 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 16:12:42,078 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,078 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,081 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:42,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:42,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:42,083 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:42,085 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,085 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,085 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,087 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,087 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 16:12:42,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,088 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,088 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:42,089 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,089 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 16:12:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-15 16:12:42,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:42,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,091 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:42,091 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:42,092 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:42,093 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:42,093 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:42,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,093 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:42,093 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:42,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:42,096 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:42,096 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:42,096 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,102 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,103 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,103 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,103 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:42,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 16:12:42,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45338cb3[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:42,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 16:12:42,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45338cb3[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:42,110 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 16:12:42,110 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,112 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:42,112 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:42,112 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:42,112 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:42,113 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:42,112 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:12:42,113 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:42,113 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,113 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. started... 2023-07-15 16:12:42,113 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,113 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:42,114 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:42,114 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:42,115 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:42,115 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. started... 2023-07-15 16:12:42,115 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:42,115 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:42,115 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:42,121 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc40cd95f7ecc77009aeec3325906538: 2023-07-15 16:12:42,123 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 98ffb5bd5824bd7695f57cad6d6c9b97: 2023-07-15 16:12:42,124 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,125 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:42,125 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:42,123 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,127 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:42,127 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:42,207 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. completed. 2023-07-15 16:12:42,207 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:42,207 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:42,207 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:42,207 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,207 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:42,207 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:12:42,209 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:42,209 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,209 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:42,209 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:42,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,215 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. completed. 2023-07-15 16:12:42,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33799,1689437455269': 2023-07-15 16:12:42,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 16:12:42,215 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:12:42,221 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:42,221 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:42,221 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,221 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:12:42,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 16:12:42,229 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 16:12:42,229 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:42,229 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:42,229 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,229 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:42,231 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,231 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,231 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,231 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,231 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,231 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,231 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,232 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,240 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,240 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,242 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,243 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,244 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,255 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,255 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:42,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:42,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:12:42,257 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,257 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,259 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 16:12:42,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,257 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,283 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:42,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:42,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:42,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,286 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:12:42,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,469 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 16:12:42,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,470 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,470 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689437561980Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689437562285 (+305 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689437562285Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689437562285Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689437562293 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689437562360 (+67 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689437562469 (+109 ms) 2023-07-15 16:12:42,476 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:42,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 495 msec 2023-07-15 16:12:42,586 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:42,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:42,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33799] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:42,595 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:42,595 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:42,595 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:42,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:42,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437562614 (current time:1689437562614). 2023-07-15 16:12:42,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:42,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x6a82eb0f to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:42,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72f234e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:42,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:42,644 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:42,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a82eb0f to 127.0.0.1:62768 2023-07-15 16:12:42,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:42,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x503a3428 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:42,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d1d77b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:42,657 DEBUG [hconnection-0x4e2b3bfb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:42,658 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:42,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:42,665 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:42,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x503a3428 to 127.0.0.1:62768 2023-07-15 16:12:42,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:42,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-15 16:12:42,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:42,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:42,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:42,671 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:42,672 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689438162672 2023-07-15 16:12:42,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-15 16:12:42,672 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:42,674 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:42,674 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:42,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:42,676 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-15 16:12:42,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-15 16:12:42,680 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:42,681 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689438162681 2023-07-15 16:12:42,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,693 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-15 16:12:42,693 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:42,695 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-15 16:12:42,695 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-15 16:12:42,695 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,695 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,697 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,697 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,697 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,697 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,697 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,697 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,698 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,698 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:42,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,699 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:42,699 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:42,699 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:42,699 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:42,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,703 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:42,703 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:42,703 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:42,701 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:42,703 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:42,703 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-15 16:12:42,703 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:42,703 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:42,705 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,705 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,705 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,710 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,709 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-15 16:12:42,710 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,710 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,710 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:42,710 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-15 16:12:42,711 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-15 16:12:42,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,713 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,713 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 16:12:42,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32764b40[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:42,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-15 16:12:42,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32764b40[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:42,719 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-15 16:12:42,719 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-15 16:12:42,725 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,725 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:42,726 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:12:42,726 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:42,726 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:42,726 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:42,726 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:42,726 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:42,726 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. started... 2023-07-15 16:12:42,726 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:42,726 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,726 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:42,726 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. started... 2023-07-15 16:12:42,726 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dc40cd95f7ecc77009aeec3325906538 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-15 16:12:42,726 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 98ffb5bd5824bd7695f57cad6d6c9b97 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-15 16:12:42,727 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:42,727 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:42,727 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:42,764 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307159814f6b59d5b4253a481023aafe1c175 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307159814f6b59d5b4253a481023aafe1c175 2023-07-15 16:12:42,769 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071518cbba3ce46a4419bd817d2278b7d1be to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071518cbba3ce46a4419bd817d2278b7d1be 2023-07-15 16:12:42,774 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:42,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:42,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:42,776 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:42,787 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/.tmp/cf/651e44fc4af64219bdee811d0ddca74a 2023-07-15 16:12:42,792 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/.tmp/cf/26c4265ceb944afca76ee6732cdc0305 2023-07-15 16:12:42,799 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/.tmp/cf/651e44fc4af64219bdee811d0ddca74a as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/cf/651e44fc4af64219bdee811d0ddca74a 2023-07-15 16:12:42,804 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/.tmp/cf/26c4265ceb944afca76ee6732cdc0305 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/cf/26c4265ceb944afca76ee6732cdc0305 2023-07-15 16:12:42,805 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/cf/651e44fc4af64219bdee811d0ddca74a, entries=46, sequenceid=6, filesize=12.9 K 2023-07-15 16:12:42,806 INFO [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for dc40cd95f7ecc77009aeec3325906538 in 79ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:42,806 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-15 16:12:42,806 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc40cd95f7ecc77009aeec3325906538: 2023-07-15 16:12:42,806 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,806 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:42,806 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/cf/651e44fc4af64219bdee811d0ddca74a] hfiles 2023-07-15 16:12:42,806 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/cf/651e44fc4af64219bdee811d0ddca74a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,812 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/cf/26c4265ceb944afca76ee6732cdc0305, entries=4, sequenceid=6, filesize=5.6 K 2023-07-15 16:12:42,813 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 98ffb5bd5824bd7695f57cad6d6c9b97 in 87ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:42,823 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 98ffb5bd5824bd7695f57cad6d6c9b97: 2023-07-15 16:12:42,824 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,825 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:42,825 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/cf/26c4265ceb944afca76ee6732cdc0305] hfiles 2023-07-15 16:12:42,826 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/cf/26c4265ceb944afca76ee6732cdc0305 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,892 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. completed. 2023-07-15 16:12:42,892 DEBUG [rs(jenkins-hbase4.apache.org,33799,1689437455269)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:42,892 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:42,892 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:42,892 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,893 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:42,893 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:12:42,894 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:42,894 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,894 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:42,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,895 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:42,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33799,1689437455269': 2023-07-15 16:12:42,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-15 16:12:42,906 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. completed. 2023-07-15 16:12:42,906 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:42,906 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:42,906 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:42,906 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,906 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-15 16:12:42,907 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:12:42,908 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,908 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-15 16:12:42,908 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:42,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,908 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-15 16:12:42,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:12:42,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-15 16:12:42,918 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-15 16:12:42,918 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:42,918 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:42,918 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,918 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:42,925 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,925 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,925 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,925 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,931 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,931 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:42,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,931 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:42,932 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,932 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:42,933 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:42,934 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,935 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,935 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,938 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,938 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,938 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,938 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,938 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,938 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,938 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:42,938 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,939 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,940 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,939 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:42,940 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,940 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,941 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:12:42,941 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,941 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,941 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:42,941 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,941 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307159814f6b59d5b4253a481023aafe1c175, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071518cbba3ce46a4419bd817d2278b7d1be] mob files 2023-07-15 16:12:42,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307159814f6b59d5b4253a481023aafe1c175 2023-07-15 16:12:42,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071518cbba3ce46a4419bd817d2278b7d1be 2023-07-15 16:12:42,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:42,942 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:42,942 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:42,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:42,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:42,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:42,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:42,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-15 16:12:42,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,953 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:42,976 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:42,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:42,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:42,977 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:12:43,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:43,030 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-15 16:12:43,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:43,030 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:43,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689437562672Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689437562952 (+280 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689437562952Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689437562952Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689437562980 (+28 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689437562996 (+16 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689437563030 (+34 ms) 2023-07-15 16:12:43,035 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-15 16:12:43,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 361 msec 2023-07-15 16:12:43,278 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:43,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-15 16:12:43,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:43,280 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280 2023-07-15 16:12:43,280 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34451, tgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280, rawTgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280, srcFsUri=hdfs://localhost:34451, srcDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:12:43,308 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:12:43,308 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1425227966_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:43,309 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9, snapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-15 16:12:43,328 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:43,383 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:43,384 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:43,384 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:43,385 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:44,488 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-348732728472767592.jar 2023-07-15 16:12:44,489 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:44,490 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:44,577 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-4880926210798789115.jar 2023-07-15 16:12:44,577 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:44,578 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:44,578 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:44,579 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:44,579 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:44,579 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:44,580 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:12:44,580 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:12:44,580 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:12:44,581 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:12:44,581 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:12:44,582 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:12:44,582 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:12:44,583 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:12:44,583 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:12:44,584 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:12:44,584 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:44,585 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:44,585 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:44,586 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:44,586 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:12:44,586 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:44,587 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:12:44,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0005_000001 (auth:SIMPLE) 2023-07-15 16:12:46,174 WARN [Listener at jenkins-hbase4.apache.org/38899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:12:46,177 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-15 16:12:46,287 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:12:46,352 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:46,352 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:12:46,470 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0006_000001 (auth:SIMPLE) 2023-07-15 16:12:52,574 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0006_000001 (auth:SIMPLE) 2023-07-15 16:12:55,720 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:12:55,721 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:12:55,731 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:55,731 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:12:55,732 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:12:55,732 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:55,732 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 16:12:55,733 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 16:12:55,733 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:55,733 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-15 16:12:55,733 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437563280/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-15 16:12:55,739 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-15 16:12:55,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-15 16:12:55,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:55,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 16:12:55,747 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437575746"}]},"ts":"1689437575746"} 2023-07-15 16:12:55,748 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-15 16:12:55,750 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-15 16:12:55,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=98ffb5bd5824bd7695f57cad6d6c9b97, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc40cd95f7ecc77009aeec3325906538, UNASSIGN}] 2023-07-15 16:12:55,753 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=98ffb5bd5824bd7695f57cad6d6c9b97, UNASSIGN 2023-07-15 16:12:55,753 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc40cd95f7ecc77009aeec3325906538, UNASSIGN 2023-07-15 16:12:55,755 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=98ffb5bd5824bd7695f57cad6d6c9b97, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:55,755 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=dc40cd95f7ecc77009aeec3325906538, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:55,755 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437575755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437575755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437575755"}]},"ts":"1689437575755"} 2023-07-15 16:12:55,755 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437575755"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437575755"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437575755"}]},"ts":"1689437575755"} 2023-07-15 16:12:55,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 98ffb5bd5824bd7695f57cad6d6c9b97, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:12:55,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure dc40cd95f7ecc77009aeec3325906538, server=jenkins-hbase4.apache.org,33799,1689437455269}] 2023-07-15 16:12:55,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 16:12:55,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:55,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 98ffb5bd5824bd7695f57cad6d6c9b97, disabling compactions & flushes 2023-07-15 16:12:55,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:55,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:55,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. after waiting 0 ms 2023-07-15 16:12:55,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:55,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:55,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc40cd95f7ecc77009aeec3325906538, disabling compactions & flushes 2023-07-15 16:12:55,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:55,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:55,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. after waiting 0 ms 2023-07-15 16:12:55,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:55,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:55,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:12:55,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:55,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97. 2023-07-15 16:12:55,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 98ffb5bd5824bd7695f57cad6d6c9b97: 2023-07-15 16:12:55,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:12:55,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538. 2023-07-15 16:12:55,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc40cd95f7ecc77009aeec3325906538: 2023-07-15 16:12:55,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:55,973 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=98ffb5bd5824bd7695f57cad6d6c9b97, regionState=CLOSED 2023-07-15 16:12:55,973 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437575973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437575973"}]},"ts":"1689437575973"} 2023-07-15 16:12:55,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:55,974 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=dc40cd95f7ecc77009aeec3325906538, regionState=CLOSED 2023-07-15 16:12:55,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689437575974"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437575974"}]},"ts":"1689437575974"} 2023-07-15 16:12:55,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-15 16:12:55,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 98ffb5bd5824bd7695f57cad6d6c9b97, server=jenkins-hbase4.apache.org,46287,1689437455210 in 227 msec 2023-07-15 16:12:55,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-15 16:12:55,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=98ffb5bd5824bd7695f57cad6d6c9b97, UNASSIGN in 240 msec 2023-07-15 16:12:55,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure dc40cd95f7ecc77009aeec3325906538, server=jenkins-hbase4.apache.org,33799,1689437455269 in 229 msec 2023-07-15 16:12:55,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-15 16:12:55,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=dc40cd95f7ecc77009aeec3325906538, UNASSIGN in 244 msec 2023-07-15 16:12:55,999 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437575999"}]},"ts":"1689437575999"} 2023-07-15 16:12:56,000 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-15 16:12:56,002 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-15 16:12:56,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 264 msec 2023-07-15 16:12:56,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-15 16:12:56,046 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-15 16:12:56,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,055 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,055 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,058 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,061 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,061 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,061 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,061 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 16:12:56,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 16:12:56,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 16:12:56,062 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-15 16:12:56,063 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,063 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,063 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:56,063 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,063 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:56,063 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,063 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:56,063 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:56,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 16:12:56,066 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:56,067 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:56,069 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/recovered.edits] 2023-07-15 16:12:56,069 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/recovered.edits] 2023-07-15 16:12:56,083 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/cf/651e44fc4af64219bdee811d0ddca74a to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/cf/651e44fc4af64219bdee811d0ddca74a 2023-07-15 16:12:56,084 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/cf/26c4265ceb944afca76ee6732cdc0305 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/cf/26c4265ceb944afca76ee6732cdc0305 2023-07-15 16:12:56,087 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538/recovered.edits/9.seqid 2023-07-15 16:12:56,088 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/dc40cd95f7ecc77009aeec3325906538 2023-07-15 16:12:56,090 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97/recovered.edits/9.seqid 2023-07-15 16:12:56,090 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testEmptyExportFileSystemState/98ffb5bd5824bd7695f57cad6d6c9b97 2023-07-15 16:12:56,090 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-15 16:12:56,091 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-15 16:12:56,092 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-15 16:12:56,096 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307159814f6b59d5b4253a481023aafe1c175 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307159814f6b59d5b4253a481023aafe1c175 2023-07-15 16:12:56,098 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071518cbba3ce46a4419bd817d2278b7d1be to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023071518cbba3ce46a4419bd817d2278b7d1be 2023-07-15 16:12:56,099 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-15 16:12:56,101 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,109 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-15 16:12:56,114 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-15 16:12:56,120 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,120 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-15 16:12:56,120 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437576120"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:56,120 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437576120"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:56,132 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:12:56,132 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 98ffb5bd5824bd7695f57cad6d6c9b97, NAME => 'testtb-testEmptyExportFileSystemState,,1689437561268.98ffb5bd5824bd7695f57cad6d6c9b97.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => dc40cd95f7ecc77009aeec3325906538, NAME => 'testtb-testEmptyExportFileSystemState,1,1689437561268.dc40cd95f7ecc77009aeec3325906538.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:12:56,132 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-15 16:12:56,132 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437576132"}]},"ts":"9223372036854775807"} 2023-07-15 16:12:56,135 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-15 16:12:56,138 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-15 16:12:56,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 91 msec 2023-07-15 16:12:56,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-15 16:12:56,166 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-15 16:12:56,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-15 16:12:56,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:56,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-15 16:12:56,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-15 16:12:56,219 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=761 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:35492 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:37343 from appattempt_1689437464440_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-157026422_1 at /127.0.0.1:54274 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:54334 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:33269 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:35424 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4792 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=917 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=677 (was 620) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=1585 (was 2473) 2023-07-15 16:12:56,219 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 16:12:56,247 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=677, ProcessCount=184, AvailableMemoryMB=1584 2023-07-15 16:12:56,247 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-15 16:12:56,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-15 16:12:56,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:56,254 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-15 16:12:56,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-15 16:12:56,256 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-15 16:12:56,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 16:12:56,258 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:12:56,258 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:12:56,259 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962 empty. 2023-07-15 16:12:56,259 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3 empty. 2023-07-15 16:12:56,259 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:12:56,260 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:12:56,260 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 16:12:56,276 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-15 16:12:56,277 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 67a8f11fd932609bba8c9d8f7ac665b3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:12:56,277 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 21d3fe7b2b2b4f238ad962b5d2763962, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp 2023-07-15 16:12:56,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:56,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 67a8f11fd932609bba8c9d8f7ac665b3, disabling compactions & flushes 2023-07-15 16:12:56,313 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:56,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:56,313 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. after waiting 0 ms 2023-07-15 16:12:56,314 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:56,314 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:56,314 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 67a8f11fd932609bba8c9d8f7ac665b3: 2023-07-15 16:12:56,314 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:56,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 21d3fe7b2b2b4f238ad962b5d2763962, disabling compactions & flushes 2023-07-15 16:12:56,315 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:56,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:56,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. after waiting 0 ms 2023-07-15 16:12:56,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:56,315 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:56,315 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 21d3fe7b2b2b4f238ad962b5d2763962: 2023-07-15 16:12:56,320 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-15 16:12:56,321 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437576321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437576321"}]},"ts":"1689437576321"} 2023-07-15 16:12:56,321 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437576321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437576321"}]},"ts":"1689437576321"} 2023-07-15 16:12:56,323 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-15 16:12:56,324 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-15 16:12:56,324 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437576324"}]},"ts":"1689437576324"} 2023-07-15 16:12:56,326 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-15 16:12:56,330 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-15 16:12:56,336 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-15 16:12:56,336 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-15 16:12:56,336 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-15 16:12:56,336 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-15 16:12:56,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21d3fe7b2b2b4f238ad962b5d2763962, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=67a8f11fd932609bba8c9d8f7ac665b3, ASSIGN}] 2023-07-15 16:12:56,339 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21d3fe7b2b2b4f238ad962b5d2763962, ASSIGN 2023-07-15 16:12:56,340 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=67a8f11fd932609bba8c9d8f7ac665b3, ASSIGN 2023-07-15 16:12:56,340 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21d3fe7b2b2b4f238ad962b5d2763962, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46287,1689437455210; forceNewPlan=false, retain=false 2023-07-15 16:12:56,340 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=67a8f11fd932609bba8c9d8f7ac665b3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43477,1689437455090; forceNewPlan=false, retain=false 2023-07-15 16:12:56,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 16:12:56,491 INFO [jenkins-hbase4:38191] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-15 16:12:56,494 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=67a8f11fd932609bba8c9d8f7ac665b3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:56,494 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=21d3fe7b2b2b4f238ad962b5d2763962, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:56,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437576494"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437576494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437576494"}]},"ts":"1689437576494"} 2023-07-15 16:12:56,495 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437576494"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437576494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437576494"}]},"ts":"1689437576494"} 2023-07-15 16:12:56,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 67a8f11fd932609bba8c9d8f7ac665b3, server=jenkins-hbase4.apache.org,43477,1689437455090}] 2023-07-15 16:12:56,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 21d3fe7b2b2b4f238ad962b5d2763962, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:12:56,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 16:12:56,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:56,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 67a8f11fd932609bba8c9d8f7ac665b3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.', STARTKEY => '1', ENDKEY => ''} 2023-07-15 16:12:56,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. service=AccessControlService 2023-07-15 16:12:56,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:56,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:56,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 21d3fe7b2b2b4f238ad962b5d2763962, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.', STARTKEY => '', ENDKEY => '1'} 2023-07-15 16:12:56,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:12:56,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:56,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:12:56,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:12:56,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. service=AccessControlService 2023-07-15 16:12:56,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-15 16:12:56,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:12:56,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-15 16:12:56,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:12:56,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:12:56,666 INFO [StoreOpener-67a8f11fd932609bba8c9d8f7ac665b3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:12:56,666 INFO [StoreOpener-21d3fe7b2b2b4f238ad962b5d2763962-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:12:56,668 DEBUG [StoreOpener-21d3fe7b2b2b4f238ad962b5d2763962-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/cf 2023-07-15 16:12:56,668 DEBUG [StoreOpener-21d3fe7b2b2b4f238ad962b5d2763962-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/cf 2023-07-15 16:12:56,668 DEBUG [StoreOpener-67a8f11fd932609bba8c9d8f7ac665b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/cf 2023-07-15 16:12:56,668 DEBUG [StoreOpener-67a8f11fd932609bba8c9d8f7ac665b3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/cf 2023-07-15 16:12:56,668 INFO [StoreOpener-21d3fe7b2b2b4f238ad962b5d2763962-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 21d3fe7b2b2b4f238ad962b5d2763962 columnFamilyName cf 2023-07-15 16:12:56,668 INFO [StoreOpener-67a8f11fd932609bba8c9d8f7ac665b3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a8f11fd932609bba8c9d8f7ac665b3 columnFamilyName cf 2023-07-15 16:12:56,670 INFO [StoreOpener-67a8f11fd932609bba8c9d8f7ac665b3-1] regionserver.HStore(310): Store=67a8f11fd932609bba8c9d8f7ac665b3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:56,670 INFO [StoreOpener-21d3fe7b2b2b4f238ad962b5d2763962-1] regionserver.HStore(310): Store=21d3fe7b2b2b4f238ad962b5d2763962/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-15 16:12:56,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:12:56,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:12:56,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:12:56,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:12:56,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:12:56,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:56,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 21d3fe7b2b2b4f238ad962b5d2763962; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58842098, jitterRate=-0.12318441271781921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:56,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 21d3fe7b2b2b4f238ad962b5d2763962: 2023-07-15 16:12:56,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962., pid=109, masterSystemTime=1689437576657 2023-07-15 16:12:56,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:12:56,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:56,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:56,684 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=21d3fe7b2b2b4f238ad962b5d2763962, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:56,684 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437576684"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437576684"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437576684"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437576684"}]},"ts":"1689437576684"} 2023-07-15 16:12:56,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-15 16:12:56,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 67a8f11fd932609bba8c9d8f7ac665b3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74145512, jitterRate=0.10485422611236572}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-15 16:12:56,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 67a8f11fd932609bba8c9d8f7ac665b3: 2023-07-15 16:12:56,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3., pid=108, masterSystemTime=1689437576652 2023-07-15 16:12:56,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:56,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:56,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-15 16:12:56,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 21d3fe7b2b2b4f238ad962b5d2763962, server=jenkins-hbase4.apache.org,46287,1689437455210 in 186 msec 2023-07-15 16:12:56,694 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=67a8f11fd932609bba8c9d8f7ac665b3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:56,694 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437576694"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689437576694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689437576694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689437576694"}]},"ts":"1689437576694"} 2023-07-15 16:12:56,695 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21d3fe7b2b2b4f238ad962b5d2763962, ASSIGN in 358 msec 2023-07-15 16:12:56,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-15 16:12:56,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 67a8f11fd932609bba8c9d8f7ac665b3, server=jenkins-hbase4.apache.org,43477,1689437455090 in 197 msec 2023-07-15 16:12:56,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-15 16:12:56,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=67a8f11fd932609bba8c9d8f7ac665b3, ASSIGN in 362 msec 2023-07-15 16:12:56,701 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-15 16:12:56,701 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437576701"}]},"ts":"1689437576701"} 2023-07-15 16:12:56,702 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-15 16:12:56,705 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-15 16:12:56,705 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-15 16:12:56,707 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 16:12:56,709 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:56,709 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:56,709 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:56,709 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:12:56,710 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:56,710 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:56,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:56,711 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-15 16:12:56,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 461 msec 2023-07-15 16:12:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-15 16:12:56,860 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-15 16:12:56,863 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:56,863 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:56,865 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:56,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:56,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437576884 (current time:1689437576884). 2023-07-15 16:12:56,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:56,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x0fdeb23d to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:56,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e170401, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:56,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:56,906 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53024, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:56,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fdeb23d to 127.0.0.1:62768 2023-07-15 16:12:56,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:56,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x75d4dc33 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:56,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f61d7ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:56,919 DEBUG [hconnection-0x1940ed0f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:56,922 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:56,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:56,929 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:56,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75d4dc33 to 127.0.0.1:62768 2023-07-15 16:12:56,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:56,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 16:12:56,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:56,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:56,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:56,934 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:56,935 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689438176935 2023-07-15 16:12:56,935 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:56,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:56,936 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:56,937 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:56,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:56,938 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:56,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-15 16:12:56,939 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:56,940 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689438176940 2023-07-15 16:12:56,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:56,969 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 16:12:56,969 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:56,972 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 16:12:56,972 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 16:12:57,037 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:57,039 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,039 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:57,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:57,040 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:57,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:57,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:57,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:57,041 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:57,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:57,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:57,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:57,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:57,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:57,042 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,042 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,042 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,042 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,044 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:57,044 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:57,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,044 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:57,044 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:57,044 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:57,045 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:57,045 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:57,045 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:57,047 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:57,048 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:57,054 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,054 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:57,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,055 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,055 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,055 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:57,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:57,055 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,055 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:57,056 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,056 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:57,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 16:12:57,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@663aa3cf[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:57,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:57,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:57,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:57,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:57,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:57,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 16:12:57,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@663aa3cf[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:57,064 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 16:12:57,064 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,067 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,067 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,067 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:12:57,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:57,068 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:57,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,068 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,075 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:57,080 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,080 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:57,081 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:57,069 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:57,092 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:57,092 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:57,092 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. started... 2023-07-15 16:12:57,092 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. started... 2023-07-15 16:12:57,092 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:57,093 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21d3fe7b2b2b4f238ad962b5d2763962: 2023-07-15 16:12:57,094 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 67a8f11fd932609bba8c9d8f7ac665b3: 2023-07-15 16:12:57,094 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,094 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:57,094 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,094 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:57,094 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:57,095 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-15 16:12:57,128 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. completed. 2023-07-15 16:12:57,128 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:57,128 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. completed. 2023-07-15 16:12:57,128 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,128 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:57,129 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:57,129 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:12:57,129 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:12:57,131 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:57,131 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,131 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:57,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:57,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:57,131 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:57,133 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:57,133 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:57,133 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:57,133 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:57,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:57,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43477,1689437455090': 2023-07-15 16:12:57,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 16:12:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:57,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:12:57,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 16:12:57,143 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 16:12:57,143 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:57,143 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:57,143 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,143 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:57,145 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,145 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,145 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:57,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,145 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,145 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:57,145 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:57,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:57,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:57,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:57,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:57,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:57,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:57,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,151 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:57,151 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,152 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:57,152 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:57,157 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,158 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,158 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,162 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:57,162 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:57,162 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:57,162 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:57,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:57,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:57,162 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:57,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:57,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:57,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:57,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:57,162 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:57,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:57,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:57,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:57,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:57,174 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,175 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,176 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:57,176 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,179 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:12:57,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-15 16:12:57,195 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,240 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:57,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:57,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:57,241 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:12:57,269 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 16:12:57,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,270 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689437576935Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689437577195 (+260 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689437577195Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689437577195Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689437577199 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689437577208 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689437577269 (+61 ms) 2023-07-15 16:12:57,272 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:57,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 336 msec 2023-07-15 16:12:57,541 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:57,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:57,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:57,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46287] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:57,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43477] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-15 16:12:57,551 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,551 DEBUG [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:57,551 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-15 16:12:57,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:57,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689437577569 (current time:1689437577569). 2023-07-15 16:12:57,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-15 16:12:57,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x214c03d4 to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:57,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f7aba67, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:57,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:57,580 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:57,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x214c03d4 to 127.0.0.1:62768 2023-07-15 16:12:57,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:57,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(139): Connect 0x5f84083d to 127.0.0.1:62768 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-15 16:12:57,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e97f2ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-15 16:12:57,687 DEBUG [hconnection-0x74d4da8d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:57,691 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:57,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-15 16:12:57,702 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-15 16:12:57,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f84083d to 127.0.0.1:62768 2023-07-15 16:12:57,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:12:57,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-15 16:12:57,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-15 16:12:57,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:57,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:57,709 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:57,710 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689438177710 2023-07-15 16:12:57,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-15 16:12:57,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,712 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-15 16:12:57,712 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-15 16:12:57,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:57,718 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-15 16:12:57,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-15 16:12:57,727 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:57,728 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689438177728 2023-07-15 16:12:57,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,756 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-15 16:12:57,756 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:57,758 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-15 16:12:57,758 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-15 16:12:57,758 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,759 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,761 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:57,761 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,761 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:57,761 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:57,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:57,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:57,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:57,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:57,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:57,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:57,761 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,762 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,762 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,762 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-15 16:12:57,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-15 16:12:57,763 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:57,764 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:57,763 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:57,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,765 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:57,765 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:57,764 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:57,765 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-15 16:12:57,765 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:57,767 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:57,767 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:57,767 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:57,769 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:57,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:57,769 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,770 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,770 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-15 16:12:57,770 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-15 16:12:57,770 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,770 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:57,771 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-15 16:12:57,771 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-15 16:12:57,771 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33799,1689437455269' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-15 16:12:57,782 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:57,783 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,783 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:57,784 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:57,784 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,784 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-15 16:12:57,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:57,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43477,1689437455090' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 16:12:57,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@787928c6[Count = 1] remaining members to acquire global barrier 2023-07-15 16:12:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:57,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:57,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46287,1689437455210' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-15 16:12:57,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@787928c6[Count = 0] remaining members to acquire global barrier 2023-07-15 16:12:57,789 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-15 16:12:57,789 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:57,795 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:57,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,795 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:57,795 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:57,795 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33799,1689437455269' in zk 2023-07-15 16:12:57,795 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:57,796 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:57,796 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:57,796 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. started... 2023-07-15 16:12:57,796 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 21d3fe7b2b2b4f238ad962b5d2763962 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-15 16:12:57,797 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:57,797 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-15 16:12:57,798 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:57,798 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:57,798 DEBUG [member: 'jenkins-hbase4.apache.org,33799,1689437455269' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-15 16:12:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-15 16:12:57,800 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-15 16:12:57,800 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:57,800 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. started... 2023-07-15 16:12:57,801 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 67a8f11fd932609bba8c9d8f7ac665b3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-15 16:12:57,813 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:57,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:57,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:57,814 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-15 16:12:57,844 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230715c12d714b7925482091c10ede3bd504d6 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230715c12d714b7925482091c10ede3bd504d6 2023-07-15 16:12:57,846 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230715c81f8a541fa7409cbcdb012161618a66 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715c81f8a541fa7409cbcdb012161618a66 2023-07-15 16:12:57,874 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/.tmp/cf/24127687bd62462e88884e1e3a2418c9 2023-07-15 16:12:57,875 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/.tmp/cf/92e6968c1a324ac8bd18ecf61e20f610 2023-07-15 16:12:57,880 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/.tmp/cf/24127687bd62462e88884e1e3a2418c9 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/cf/24127687bd62462e88884e1e3a2418c9 2023-07-15 16:12:57,884 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/.tmp/cf/92e6968c1a324ac8bd18ecf61e20f610 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/cf/92e6968c1a324ac8bd18ecf61e20f610 2023-07-15 16:12:57,887 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/cf/24127687bd62462e88884e1e3a2418c9, entries=3, sequenceid=6, filesize=5.4 K 2023-07-15 16:12:57,888 INFO [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 21d3fe7b2b2b4f238ad962b5d2763962 in 92ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:57,888 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-15 16:12:57,889 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 21d3fe7b2b2b4f238ad962b5d2763962: 2023-07-15 16:12:57,889 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,889 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:57,890 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/cf/24127687bd62462e88884e1e3a2418c9] hfiles 2023-07-15 16:12:57,890 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/cf/24127687bd62462e88884e1e3a2418c9 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,894 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/cf/92e6968c1a324ac8bd18ecf61e20f610, entries=47, sequenceid=6, filesize=13.3 K 2023-07-15 16:12:57,896 INFO [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 67a8f11fd932609bba8c9d8f7ac665b3 in 96ms, sequenceid=6, compaction requested=false 2023-07-15 16:12:57,899 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 67a8f11fd932609bba8c9d8f7ac665b3: 2023-07-15 16:12:57,899 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:57,900 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-15 16:12:57,900 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/cf/92e6968c1a324ac8bd18ecf61e20f610] hfiles 2023-07-15 16:12:57,900 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/cf/92e6968c1a324ac8bd18ecf61e20f610 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,007 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. completed. 2023-07-15 16:12:58,007 DEBUG [rs(jenkins-hbase4.apache.org,46287,1689437455210)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:12:58,007 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:58,007 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:58,007 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,007 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:58,007 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46287,1689437455210' in zk 2023-07-15 16:12:58,009 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,009 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:58,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:58,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:58,010 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:58,010 DEBUG [member: 'jenkins-hbase4.apache.org,46287,1689437455210' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:58,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:58,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:58,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:58,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,014 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:58,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:58,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46287,1689437455210': 2023-07-15 16:12:58,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46287,1689437455210' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-15 16:12:58,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:58,016 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-15 16:12:58,024 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. completed. 2023-07-15 16:12:58,024 DEBUG [rs(jenkins-hbase4.apache.org,43477,1689437455090)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:12:58,024 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-15 16:12:58,024 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-15 16:12:58,024 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,024 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-15 16:12:58,024 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43477,1689437455090' in zk 2023-07-15 16:12:58,026 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-15 16:12:58,026 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,026 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:58,026 DEBUG [member: 'jenkins-hbase4.apache.org,43477,1689437455090' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-15 16:12:58,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:58,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:58,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:58,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:58,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43477,1689437455090': 2023-07-15 16:12:58,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43477,1689437455090' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-15 16:12:58,039 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-15 16:12:58,039 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-15 16:12:58,039 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-15 16:12:58,039 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,039 INFO [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-15 16:12:58,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-15 16:12:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-15 16:12:58,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:58,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:58,041 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,042 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:58,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:58,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-15 16:12:58,042 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:58,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,047 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-15 16:12:58,047 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-15 16:12:58,049 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,050 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,050 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:58,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:58,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:58,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:58,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:58,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:58,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-15 16:12:58,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-15 16:12:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:58,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-15 16:12:58,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,055 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,055 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,054 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-15 16:12:58,055 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:12:58,055 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,055 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:12:58,055 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:12:58,055 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,055 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,055 DEBUG [(jenkins-hbase4.apache.org,38191,1689437453645)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-15 16:12:58,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-15 16:12:58,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:58,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:58,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-15 16:12:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-15 16:12:58,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715c81f8a541fa7409cbcdb012161618a66, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230715c12d714b7925482091c10ede3bd504d6] mob files 2023-07-15 16:12:58,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715c81f8a541fa7409cbcdb012161618a66 2023-07-15 16:12:58,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230715c12d714b7925482091c10ede3bd504d6 2023-07-15 16:12:58,319 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:58,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:58,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-15 16:12:58,321 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-15 16:12:58,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,528 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,565 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-15 16:12:58,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,569 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689437577710Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689437578490 (+780 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689437578490Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689437578490Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689437578494 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689437578511 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689437578565 (+54 ms) 2023-07-15 16:12:58,572 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-15 16:12:58,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 860 msec 2023-07-15 16:12:58,821 DEBUG [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-15 16:12:58,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-15 16:12:58,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-15 16:12:58,825 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825 2023-07-15 16:12:58,825 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34451, tgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825, rawTgtDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825, srcFsUri=hdfs://localhost:34451, srcDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:12:58,863 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9 2023-07-15 16:12:58,863 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-748000181_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,863 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34451, inputRoot=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9, snapshotDir=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-15 16:12:58,896 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:12:58,982 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:58,983 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:58,983 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-15 16:12:58,983 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-15 16:13:00,159 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-9190998836748837142.jar 2023-07-15 16:13:00,160 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:13:00,161 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-15 16:13:00,234 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0006_000001 (auth:SIMPLE) 2023-07-15 16:13:00,279 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/hadoop-2966589950680116235.jar 2023-07-15 16:13:00,280 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-15 16:13:00,280 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-15 16:13:00,281 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-15 16:13:00,281 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-15 16:13:00,282 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-15 16:13:00,282 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-15 16:13:00,283 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-15 16:13:00,283 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-15 16:13:00,284 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-15 16:13:00,284 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-15 16:13:00,285 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-15 16:13:00,285 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-15 16:13:00,286 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-15 16:13:00,286 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-15 16:13:00,287 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-15 16:13:00,288 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-15 16:13:00,288 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:13:00,289 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:13:00,290 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:13:00,290 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:13:00,290 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-15 16:13:00,291 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:13:00,292 DEBUG [Listener at jenkins-hbase4.apache.org/38899] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-15 16:13:01,629 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:13:01,750 WARN [Listener at jenkins-hbase4.apache.org/38899] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-15 16:13:01,753 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-15 16:13:01,756 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-15 16:13:01,928 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:13:01,928 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-15 16:13:02,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0007_000001 (auth:SIMPLE) 2023-07-15 16:13:08,725 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0007_000001 (auth:SIMPLE) 2023-07-15 16:13:11,044 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0007_000001 (auth:SIMPLE) 2023-07-15 16:13:14,708 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0007_000001 (auth:SIMPLE) 2023-07-15 16:13:16,136 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-15 16:13:16,136 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-15 16:13:16,150 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,150 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-15 16:13:16,151 INFO [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-15 16:13:16,151 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,152 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 16:13:16,152 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 16:13:16,152 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1343666496_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,153 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-15 16:13:16,153 DEBUG [Listener at jenkins-hbase4.apache.org/38899] snapshot.TestExportSnapshot(367): hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/export-test/export-1689437578825/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-15 16:13:16,159 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,163 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437596163"}]},"ts":"1689437596163"} 2023-07-15 16:13:16,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 16:13:16,165 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-15 16:13:16,166 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-15 16:13:16,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21d3fe7b2b2b4f238ad962b5d2763962, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=67a8f11fd932609bba8c9d8f7ac665b3, UNASSIGN}] 2023-07-15 16:13:16,169 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21d3fe7b2b2b4f238ad962b5d2763962, UNASSIGN 2023-07-15 16:13:16,170 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=67a8f11fd932609bba8c9d8f7ac665b3, UNASSIGN 2023-07-15 16:13:16,172 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=67a8f11fd932609bba8c9d8f7ac665b3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:13:16,172 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=21d3fe7b2b2b4f238ad962b5d2763962, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:13:16,172 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437596172"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437596172"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437596172"}]},"ts":"1689437596172"} 2023-07-15 16:13:16,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437596172"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689437596172"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689437596172"}]},"ts":"1689437596172"} 2023-07-15 16:13:16,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 67a8f11fd932609bba8c9d8f7ac665b3, server=jenkins-hbase4.apache.org,43477,1689437455090}] 2023-07-15 16:13:16,174 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 21d3fe7b2b2b4f238ad962b5d2763962, server=jenkins-hbase4.apache.org,46287,1689437455210}] 2023-07-15 16:13:16,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 16:13:16,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:13:16,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 67a8f11fd932609bba8c9d8f7ac665b3, disabling compactions & flushes 2023-07-15 16:13:16,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:13:16,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:13:16,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. after waiting 0 ms 2023-07-15 16:13:16,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:13:16,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:13:16,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 21d3fe7b2b2b4f238ad962b5d2763962, disabling compactions & flushes 2023-07-15 16:13:16,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:13:16,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:13:16,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. after waiting 0 ms 2023-07-15 16:13:16,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:13:16,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:13:16,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:13:16,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:16,341 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3. 2023-07-15 16:13:16,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 67a8f11fd932609bba8c9d8f7ac665b3: 2023-07-15 16:13:16,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:16,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962. 2023-07-15 16:13:16,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 21d3fe7b2b2b4f238ad962b5d2763962: 2023-07-15 16:13:16,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:13:16,345 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=67a8f11fd932609bba8c9d8f7ac665b3, regionState=CLOSED 2023-07-15 16:13:16,345 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437596345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437596345"}]},"ts":"1689437596345"} 2023-07-15 16:13:16,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:13:16,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=21d3fe7b2b2b4f238ad962b5d2763962, regionState=CLOSED 2023-07-15 16:13:16,346 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689437596346"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689437596346"}]},"ts":"1689437596346"} 2023-07-15 16:13:16,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-15 16:13:16,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 67a8f11fd932609bba8c9d8f7ac665b3, server=jenkins-hbase4.apache.org,43477,1689437455090 in 174 msec 2023-07-15 16:13:16,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-15 16:13:16,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 21d3fe7b2b2b4f238ad962b5d2763962, server=jenkins-hbase4.apache.org,46287,1689437455210 in 174 msec 2023-07-15 16:13:16,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=67a8f11fd932609bba8c9d8f7ac665b3, UNASSIGN in 182 msec 2023-07-15 16:13:16,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-15 16:13:16,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=21d3fe7b2b2b4f238ad962b5d2763962, UNASSIGN in 183 msec 2023-07-15 16:13:16,352 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689437596352"}]},"ts":"1689437596352"} 2023-07-15 16:13:16,353 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-15 16:13:16,355 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-15 16:13:16,357 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 197 msec 2023-07-15 16:13:16,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-15 16:13:16,466 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-15 16:13:16,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,470 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,470 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,471 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43477] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,475 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:13:16,475 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:13:16,475 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,475 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,475 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,475 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,475 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 16:13:16,475 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 16:13:16,476 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 16:13:16,477 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/recovered.edits] 2023-07-15 16:13:16,477 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/cf, FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/recovered.edits] 2023-07-15 16:13:16,479 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-15 16:13:16,479 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,479 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,479 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:13:16,479 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,479 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,480 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:13:16,480 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:13:16,479 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-15 16:13:16,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 16:13:16,482 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/cf/24127687bd62462e88884e1e3a2418c9 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/cf/24127687bd62462e88884e1e3a2418c9 2023-07-15 16:13:16,482 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/cf/92e6968c1a324ac8bd18ecf61e20f610 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/cf/92e6968c1a324ac8bd18ecf61e20f610 2023-07-15 16:13:16,485 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962/recovered.edits/9.seqid 2023-07-15 16:13:16,485 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/21d3fe7b2b2b4f238ad962b5d2763962 2023-07-15 16:13:16,486 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/recovered.edits/9.seqid to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3/recovered.edits/9.seqid 2023-07-15 16:13:16,486 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/67a8f11fd932609bba8c9d8f7ac665b3 2023-07-15 16:13:16,487 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-15 16:13:16,487 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-15 16:13:16,488 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-15 16:13:16,491 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715c81f8a541fa7409cbcdb012161618a66 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230715c81f8a541fa7409cbcdb012161618a66 2023-07-15 16:13:16,492 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230715c12d714b7925482091c10ede3bd504d6 to hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230715c12d714b7925482091c10ede3bd504d6 2023-07-15 16:13:16,492 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-15 16:13:16,494 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,496 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-15 16:13:16,498 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-15 16:13:16,499 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,499 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-15 16:13:16,499 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437596499"}]},"ts":"9223372036854775807"} 2023-07-15 16:13:16,499 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689437596499"}]},"ts":"9223372036854775807"} 2023-07-15 16:13:16,500 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-15 16:13:16,500 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 21d3fe7b2b2b4f238ad962b5d2763962, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689437576248.21d3fe7b2b2b4f238ad962b5d2763962.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 67a8f11fd932609bba8c9d8f7ac665b3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689437576248.67a8f11fd932609bba8c9d8f7ac665b3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-15 16:13:16,501 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-15 16:13:16,501 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689437596501"}]},"ts":"9223372036854775807"} 2023-07-15 16:13:16,502 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-15 16:13:16,504 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-07-15 16:13:16,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-15 16:13:16,581 INFO [Listener at jenkins-hbase4.apache.org/38899] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-15 16:13:16,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 16:13:16,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-15 16:13:16,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38191] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-15 16:13:16,616 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 761) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:56290 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (715431365) connection to jenkins-hbase4.apache.org/172.31.14.131:33109 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-889850125_17 at /127.0.0.1:43664 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_594078201_1 at /127.0.0.1:54576 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_594078201_1 at /127.0.0.1:56274 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4be88134-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5432 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1343666496_17 at /127.0.0.1:54594 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=898 (was 917), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=730 (was 677) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 184), AvailableMemoryMB=1641 (was 1584) - AvailableMemoryMB LEAK? - 2023-07-15 16:13:16,616 WARN [Listener at jenkins-hbase4.apache.org/38899] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-15 16:13:16,616 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-15 16:13:16,629 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 16:13:20,908 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689437464440_0007_000001 (auth:SIMPLE) 2023-07-15 16:13:21,911 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-15 16:13:30,763 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 16:13:44,880 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 16:13:44,881 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 16:13:44,990 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-15 16:13:44,999 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-15 16:13:45,000 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 16:13:45,011 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-15 16:13:45,115 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-15 16:13:45,115 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-15 16:13:45,115 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-15 16:13:45,116 INFO [Listener at jenkins-hbase4.apache.org/38899] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-15 16:13:45,116 DEBUG [Listener at jenkins-hbase4.apache.org/38899] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2645710c to 127.0.0.1:62768 2023-07-15 16:13:45,116 DEBUG [Listener at jenkins-hbase4.apache.org/38899] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:45,117 DEBUG [Listener at jenkins-hbase4.apache.org/38899] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-15 16:13:45,117 DEBUG [Listener at jenkins-hbase4.apache.org/38899] util.JVMClusterUtil(257): Found active master hash=98625475, stopped=false 2023-07-15 16:13:45,117 DEBUG [Listener at jenkins-hbase4.apache.org/38899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:45,117 DEBUG [Listener at jenkins-hbase4.apache.org/38899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-15 16:13:45,117 INFO [Listener at jenkins-hbase4.apache.org/38899] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:13:45,120 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:13:45,120 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:13:45,120 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:13:45,120 INFO [Listener at jenkins-hbase4.apache.org/38899] procedure2.ProcedureExecutor(629): Stopping 2023-07-15 16:13:45,120 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-15 16:13:45,120 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:13:45,121 DEBUG [Listener at jenkins-hbase4.apache.org/38899] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x013ed4f9 to 127.0.0.1:62768 2023-07-15 16:13:45,121 DEBUG [Listener at jenkins-hbase4.apache.org/38899] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:45,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:13:45,121 INFO [Listener at jenkins-hbase4.apache.org/38899] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43477,1689437455090' ***** 2023-07-15 16:13:45,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:13:45,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:13:45,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-15 16:13:45,122 DEBUG [Listener at jenkins-hbase4.apache.org/38899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:45,122 INFO [Listener at jenkins-hbase4.apache.org/38899] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 16:13:45,122 INFO [Listener at jenkins-hbase4.apache.org/38899] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46287,1689437455210' ***** 2023-07-15 16:13:45,122 DEBUG [Listener at jenkins-hbase4.apache.org/38899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:45,123 INFO [Listener at jenkins-hbase4.apache.org/38899] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 16:13:45,123 INFO [RS:0;jenkins-hbase4:43477] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 16:13:45,123 INFO [RS:1;jenkins-hbase4:46287] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 16:13:45,123 INFO [Listener at jenkins-hbase4.apache.org/38899] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33799,1689437455269' ***** 2023-07-15 16:13:45,123 DEBUG [Listener at jenkins-hbase4.apache.org/38899] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:45,123 INFO [RS:1;jenkins-hbase4:46287] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 16:13:45,123 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 16:13:45,123 INFO [RS:1;jenkins-hbase4:46287] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 16:13:45,123 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 50dbda6487f689a4a76d795e09780628 2023-07-15 16:13:45,124 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:13:45,124 DEBUG [RS:1;jenkins-hbase4:46287] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c967409 to 127.0.0.1:62768 2023-07-15 16:13:45,124 DEBUG [RS:1;jenkins-hbase4:46287] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:45,123 INFO [RS:0;jenkins-hbase4:43477] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 16:13:45,127 INFO [RS:1;jenkins-hbase4:46287] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 16:13:45,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 50dbda6487f689a4a76d795e09780628, disabling compactions & flushes 2023-07-15 16:13:45,123 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 16:13:45,123 INFO [Listener at jenkins-hbase4.apache.org/38899] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-15 16:13:45,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:13:45,127 INFO [RS:1;jenkins-hbase4:46287] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 16:13:45,128 INFO [RS:1;jenkins-hbase4:46287] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 16:13:45,128 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-15 16:13:45,127 INFO [RS:0;jenkins-hbase4:43477] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 16:13:45,128 INFO [RS:2;jenkins-hbase4:33799] regionserver.HeapMemoryManager(220): Stopping 2023-07-15 16:13:45,128 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(3305): Received CLOSE for 063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:13:45,128 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-15 16:13:45,129 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:13:45,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:13:45,129 DEBUG [RS:0;jenkins-hbase4:43477] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b405130 to 127.0.0.1:62768 2023-07-15 16:13:45,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 063b00081de8ec727d095e21e3cb33f9, disabling compactions & flushes 2023-07-15 16:13:45,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-15 16:13:45,128 INFO [RS:2;jenkins-hbase4:33799] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-15 16:13:45,128 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-15 16:13:45,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-15 16:13:45,130 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1478): Online Regions={50dbda6487f689a4a76d795e09780628=hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628., 1588230740=hbase:meta,,1.1588230740} 2023-07-15 16:13:45,130 INFO [RS:2;jenkins-hbase4:33799] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-15 16:13:45,130 INFO [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:13:45,130 DEBUG [RS:2;jenkins-hbase4:33799] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x404d3043 to 127.0.0.1:62768 2023-07-15 16:13:45,130 DEBUG [RS:2;jenkins-hbase4:33799] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:45,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:13:45,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:13:45,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. after waiting 0 ms 2023-07-15 16:13:45,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:13:45,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 063b00081de8ec727d095e21e3cb33f9 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-15 16:13:45,129 DEBUG [RS:0;jenkins-hbase4:43477] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:45,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. after waiting 0 ms 2023-07-15 16:13:45,132 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-15 16:13:45,131 INFO [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33799,1689437455269; all regions closed. 2023-07-15 16:13:45,130 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-15 16:13:45,132 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1478): Online Regions={063b00081de8ec727d095e21e3cb33f9=hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9.} 2023-07-15 16:13:45,132 DEBUG [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1504): Waiting on 063b00081de8ec727d095e21e3cb33f9 2023-07-15 16:13:45,132 DEBUG [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1504): Waiting on 1588230740, 50dbda6487f689a4a76d795e09780628 2023-07-15 16:13:45,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:13:45,132 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-15 16:13:45,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 50dbda6487f689a4a76d795e09780628 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-15 16:13:45,133 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-15 16:13:45,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-15 16:13:45,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628/.tmp/info/71026648e6b1418ca46641502f83b139 2023-07-15 16:13:45,196 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/.tmp/info/fc54930841f04fa0a3d19a4fd75f88f7 2023-07-15 16:13:45,197 DEBUG [RS:2;jenkins-hbase4:33799] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/oldWALs 2023-07-15 16:13:45,198 INFO [RS:2;jenkins-hbase4:33799] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33799%2C1689437455269:(num 1689437457440) 2023-07-15 16:13:45,198 DEBUG [RS:2;jenkins-hbase4:33799] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:45,198 INFO [RS:2;jenkins-hbase4:33799] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:45,198 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:45,198 INFO [RS:2;jenkins-hbase4:33799] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 16:13:45,198 INFO [RS:2;jenkins-hbase4:33799] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 16:13:45,198 INFO [RS:2;jenkins-hbase4:33799] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 16:13:45,198 INFO [RS:2;jenkins-hbase4:33799] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 16:13:45,199 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:13:45,200 INFO [RS:2;jenkins-hbase4:33799] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33799 2023-07-15 16:13:45,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9/.tmp/l/d4e44679368c48e3b2f7fcf418f9c592 2023-07-15 16:13:45,204 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc54930841f04fa0a3d19a4fd75f88f7 2023-07-15 16:13:45,204 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:45,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628/.tmp/info/71026648e6b1418ca46641502f83b139 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628/info/71026648e6b1418ca46641502f83b139 2023-07-15 16:13:45,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4e44679368c48e3b2f7fcf418f9c592 2023-07-15 16:13:45,209 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:13:45,209 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:45,209 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:13:45,209 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:45,209 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:45,210 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33799,1689437455269 2023-07-15 16:13:45,210 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:45,210 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33799,1689437455269] 2023-07-15 16:13:45,211 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33799,1689437455269; numProcessing=1 2023-07-15 16:13:45,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9/.tmp/l/d4e44679368c48e3b2f7fcf418f9c592 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9/l/d4e44679368c48e3b2f7fcf418f9c592 2023-07-15 16:13:45,213 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33799,1689437455269 already deleted, retry=false 2023-07-15 16:13:45,213 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33799,1689437455269 expired; onlineServers=2 2023-07-15 16:13:45,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628/info/71026648e6b1418ca46641502f83b139, entries=2, sequenceid=6, filesize=4.8 K 2023-07-15 16:13:45,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 50dbda6487f689a4a76d795e09780628 in 84ms, sequenceid=6, compaction requested=false 2023-07-15 16:13:45,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4e44679368c48e3b2f7fcf418f9c592 2023-07-15 16:13:45,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9/l/d4e44679368c48e3b2f7fcf418f9c592, entries=7, sequenceid=18, filesize=5.2 K 2023-07-15 16:13:45,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 063b00081de8ec727d095e21e3cb33f9 in 90ms, sequenceid=18, compaction requested=false 2023-07-15 16:13:45,222 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/.tmp/rep_barrier/30d7555d42fd4e42a973a9bcf3233e53 2023-07-15 16:13:45,226 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:45,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/namespace/50dbda6487f689a4a76d795e09780628/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-15 16:13:45,230 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30d7555d42fd4e42a973a9bcf3233e53 2023-07-15 16:13:45,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:45,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:13:45,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 50dbda6487f689a4a76d795e09780628: 2023-07-15 16:13:45,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689437458251.50dbda6487f689a4a76d795e09780628. 2023-07-15 16:13:45,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/acl/063b00081de8ec727d095e21e3cb33f9/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-15 16:13:45,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:45,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:13:45,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 063b00081de8ec727d095e21e3cb33f9: 2023-07-15 16:13:45,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689437459001.063b00081de8ec727d095e21e3cb33f9. 2023-07-15 16:13:45,245 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/.tmp/table/e5c1443f490d41e08c57f181c6137f93 2023-07-15 16:13:45,247 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-15 16:13:45,249 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5c1443f490d41e08c57f181c6137f93 2023-07-15 16:13:45,249 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/.tmp/info/fc54930841f04fa0a3d19a4fd75f88f7 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/info/fc54930841f04fa0a3d19a4fd75f88f7 2023-07-15 16:13:45,251 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-15 16:13:45,254 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc54930841f04fa0a3d19a4fd75f88f7 2023-07-15 16:13:45,254 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/info/fc54930841f04fa0a3d19a4fd75f88f7, entries=48, sequenceid=131, filesize=10.3 K 2023-07-15 16:13:45,255 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/.tmp/rep_barrier/30d7555d42fd4e42a973a9bcf3233e53 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/rep_barrier/30d7555d42fd4e42a973a9bcf3233e53 2023-07-15 16:13:45,255 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-15 16:13:45,255 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-15 16:13:45,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 30d7555d42fd4e42a973a9bcf3233e53 2023-07-15 16:13:45,260 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/rep_barrier/30d7555d42fd4e42a973a9bcf3233e53, entries=13, sequenceid=131, filesize=6.4 K 2023-07-15 16:13:45,261 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/.tmp/table/e5c1443f490d41e08c57f181c6137f93 as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/table/e5c1443f490d41e08c57f181c6137f93 2023-07-15 16:13:45,265 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5c1443f490d41e08c57f181c6137f93 2023-07-15 16:13:45,265 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/table/e5c1443f490d41e08c57f181c6137f93, entries=24, sequenceid=131, filesize=6.9 K 2023-07-15 16:13:45,266 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 133ms, sequenceid=131, compaction requested=false 2023-07-15 16:13:45,275 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-15 16:13:45,276 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-15 16:13:45,276 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-15 16:13:45,276 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-15 16:13:45,276 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-15 16:13:45,276 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-15 16:13:45,312 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:45,312 INFO [RS:2;jenkins-hbase4:33799] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33799,1689437455269; zookeeper connection closed. 2023-07-15 16:13:45,312 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:33799-0x10169c03c9a0003, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:45,312 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@610cbee0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@610cbee0 2023-07-15 16:13:45,332 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43477,1689437455090; all regions closed. 2023-07-15 16:13:45,333 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46287,1689437455210; all regions closed. 2023-07-15 16:13:45,342 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/WALs/jenkins-hbase4.apache.org,43477,1689437455090/jenkins-hbase4.apache.org%2C43477%2C1689437455090.1689437457439 not finished, retry = 0 2023-07-15 16:13:45,344 DEBUG [RS:1;jenkins-hbase4:46287] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/oldWALs 2023-07-15 16:13:45,345 INFO [RS:1;jenkins-hbase4:46287] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46287%2C1689437455210.meta:.meta(num 1689437457767) 2023-07-15 16:13:45,385 DEBUG [RS:1;jenkins-hbase4:46287] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/oldWALs 2023-07-15 16:13:45,385 INFO [RS:1;jenkins-hbase4:46287] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46287%2C1689437455210:(num 1689437457439) 2023-07-15 16:13:45,386 DEBUG [RS:1;jenkins-hbase4:46287] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:45,386 INFO [RS:1;jenkins-hbase4:46287] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:45,386 INFO [RS:1;jenkins-hbase4:46287] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-15 16:13:45,387 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:13:45,388 INFO [RS:1;jenkins-hbase4:46287] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46287 2023-07-15 16:13:45,395 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:13:45,395 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46287,1689437455210 2023-07-15 16:13:45,395 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:45,396 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46287,1689437455210] 2023-07-15 16:13:45,396 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46287,1689437455210; numProcessing=2 2023-07-15 16:13:45,397 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46287,1689437455210 already deleted, retry=false 2023-07-15 16:13:45,397 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46287,1689437455210 expired; onlineServers=1 2023-07-15 16:13:45,445 DEBUG [RS:0;jenkins-hbase4:43477] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/oldWALs 2023-07-15 16:13:45,445 INFO [RS:0;jenkins-hbase4:43477] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43477%2C1689437455090:(num 1689437457439) 2023-07-15 16:13:45,445 DEBUG [RS:0;jenkins-hbase4:43477] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:45,445 INFO [RS:0;jenkins-hbase4:43477] regionserver.LeaseManager(133): Closed leases 2023-07-15 16:13:45,445 INFO [RS:0;jenkins-hbase4:43477] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-15 16:13:45,445 INFO [RS:0;jenkins-hbase4:43477] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-15 16:13:45,445 INFO [RS:0;jenkins-hbase4:43477] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-15 16:13:45,445 INFO [RS:0;jenkins-hbase4:43477] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-15 16:13:45,445 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:13:45,447 INFO [RS:0;jenkins-hbase4:43477] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43477 2023-07-15 16:13:45,448 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-15 16:13:45,448 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43477,1689437455090 2023-07-15 16:13:45,449 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43477,1689437455090] 2023-07-15 16:13:45,449 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43477,1689437455090; numProcessing=3 2023-07-15 16:13:45,454 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43477,1689437455090 already deleted, retry=false 2023-07-15 16:13:45,454 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43477,1689437455090 expired; onlineServers=0 2023-07-15 16:13:45,454 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38191,1689437453645' ***** 2023-07-15 16:13:45,454 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-15 16:13:45,454 DEBUG [M:0;jenkins-hbase4:38191] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44ddedf8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-15 16:13:45,454 INFO [M:0;jenkins-hbase4:38191] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38191,1689437453645 2023-07-15 16:13:45,454 INFO [M:0;jenkins-hbase4:38191] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38191,1689437453645; all regions closed. 2023-07-15 16:13:45,454 DEBUG [M:0;jenkins-hbase4:38191] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-15 16:13:45,454 DEBUG [M:0;jenkins-hbase4:38191] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-15 16:13:45,454 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-15 16:13:45,454 DEBUG [M:0;jenkins-hbase4:38191] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-15 16:13:45,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689437456947] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689437456947,5,FailOnTimeoutGroup] 2023-07-15 16:13:45,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689437456948] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689437456948,5,FailOnTimeoutGroup] 2023-07-15 16:13:45,455 INFO [M:0;jenkins-hbase4:38191] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-15 16:13:45,455 INFO [M:0;jenkins-hbase4:38191] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-15 16:13:45,455 INFO [M:0;jenkins-hbase4:38191] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-15 16:13:45,455 DEBUG [M:0;jenkins-hbase4:38191] master.HMaster(1512): Stopping service threads 2023-07-15 16:13:45,455 INFO [M:0;jenkins-hbase4:38191] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-15 16:13:45,455 ERROR [M:0;jenkins-hbase4:38191] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-15 16:13:45,456 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-15 16:13:45,456 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-15 16:13:45,456 INFO [M:0;jenkins-hbase4:38191] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-15 16:13:45,456 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-15 16:13:45,456 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-15 16:13:45,457 DEBUG [M:0;jenkins-hbase4:38191] zookeeper.ZKUtil(398): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-15 16:13:45,457 WARN [M:0;jenkins-hbase4:38191] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-15 16:13:45,457 INFO [M:0;jenkins-hbase4:38191] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-15 16:13:45,457 INFO [M:0;jenkins-hbase4:38191] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-15 16:13:45,459 DEBUG [M:0;jenkins-hbase4:38191] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-15 16:13:45,459 INFO [M:0;jenkins-hbase4:38191] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:13:45,459 DEBUG [M:0;jenkins-hbase4:38191] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:13:45,459 DEBUG [M:0;jenkins-hbase4:38191] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-15 16:13:45,459 DEBUG [M:0;jenkins-hbase4:38191] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:13:45,459 INFO [M:0;jenkins-hbase4:38191] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.66 KB heapSize=451.91 KB 2023-07-15 16:13:45,496 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:45,496 INFO [RS:1;jenkins-hbase4:46287] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46287,1689437455210; zookeeper connection closed. 2023-07-15 16:13:45,496 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:46287-0x10169c03c9a0002, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:45,496 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@26c445ac] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@26c445ac 2023-07-15 16:13:45,596 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:45,596 INFO [RS:0;jenkins-hbase4:43477] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43477,1689437455090; zookeeper connection closed. 2023-07-15 16:13:45,596 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): regionserver:43477-0x10169c03c9a0001, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:45,597 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c87a058] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c87a058 2023-07-15 16:13:45,597 INFO [Listener at jenkins-hbase4.apache.org/38899] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-15 16:13:45,883 INFO [M:0;jenkins-hbase4:38191] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.66 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bb9fab6da3bd47328ef826917d88daee 2023-07-15 16:13:45,888 INFO [M:0;jenkins-hbase4:38191] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb9fab6da3bd47328ef826917d88daee 2023-07-15 16:13:45,889 DEBUG [M:0;jenkins-hbase4:38191] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/bb9fab6da3bd47328ef826917d88daee as hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bb9fab6da3bd47328ef826917d88daee 2023-07-15 16:13:45,893 INFO [M:0;jenkins-hbase4:38191] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb9fab6da3bd47328ef826917d88daee 2023-07-15 16:13:45,893 INFO [M:0;jenkins-hbase4:38191] regionserver.HStore(1080): Added hdfs://localhost:34451/user/jenkins/test-data/25717488-942f-bea0-5497-610d581f89e9/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/bb9fab6da3bd47328ef826917d88daee, entries=119, sequenceid=899, filesize=28.6 K 2023-07-15 16:13:45,894 INFO [M:0;jenkins-hbase4:38191] regionserver.HRegion(2948): Finished flush of dataSize ~375.66 KB/384673, heapSize ~451.90 KB/462744, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 435ms, sequenceid=899, compaction requested=false 2023-07-15 16:13:45,896 INFO [M:0;jenkins-hbase4:38191] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-15 16:13:45,896 DEBUG [M:0;jenkins-hbase4:38191] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-15 16:13:45,899 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-15 16:13:45,899 INFO [M:0;jenkins-hbase4:38191] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-15 16:13:45,900 INFO [M:0;jenkins-hbase4:38191] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38191 2023-07-15 16:13:45,901 DEBUG [M:0;jenkins-hbase4:38191] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38191,1689437453645 already deleted, retry=false 2023-07-15 16:13:46,004 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:46,004 DEBUG [Listener at localhost/38811-EventThread] zookeeper.ZKWatcher(600): master:38191-0x10169c03c9a0000, quorum=127.0.0.1:62768, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-15 16:13:46,004 INFO [M:0;jenkins-hbase4:38191] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38191,1689437453645; zookeeper connection closed. 2023-07-15 16:13:46,006 WARN [Listener at jenkins-hbase4.apache.org/38899] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 16:13:46,012 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:13:46,017 WARN [BP-920763789-172.31.14.131-1689437449218 heartbeating to localhost/127.0.0.1:34451] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 16:13:46,017 WARN [BP-920763789-172.31.14.131-1689437449218 heartbeating to localhost/127.0.0.1:34451] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-920763789-172.31.14.131-1689437449218 (Datanode Uuid b760099e-9470-4da0-a8cc-2f7fc227eed7) service to localhost/127.0.0.1:34451 2023-07-15 16:13:46,020 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data5/current/BP-920763789-172.31.14.131-1689437449218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:46,020 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data6/current/BP-920763789-172.31.14.131-1689437449218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:46,022 WARN [Listener at jenkins-hbase4.apache.org/38899] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 16:13:46,027 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:13:46,131 WARN [BP-920763789-172.31.14.131-1689437449218 heartbeating to localhost/127.0.0.1:34451] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-15 16:13:46,132 WARN [BP-920763789-172.31.14.131-1689437449218 heartbeating to localhost/127.0.0.1:34451] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-920763789-172.31.14.131-1689437449218 (Datanode Uuid 257ec7b5-4724-4a81-b9f3-eccedb98d2ee) service to localhost/127.0.0.1:34451 2023-07-15 16:13:46,133 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data3/current/BP-920763789-172.31.14.131-1689437449218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:46,133 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data4/current/BP-920763789-172.31.14.131-1689437449218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:46,134 WARN [Listener at jenkins-hbase4.apache.org/38899] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-15 16:13:46,144 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:13:46,187 WARN [BP-920763789-172.31.14.131-1689437449218 heartbeating to localhost/127.0.0.1:34451] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-920763789-172.31.14.131-1689437449218 (Datanode Uuid ab3cd4eb-8cb3-4fb7-9b50-c07c724aac72) service to localhost/127.0.0.1:34451 2023-07-15 16:13:46,189 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data1/current/BP-920763789-172.31.14.131-1689437449218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:46,190 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6097e75d-2031-056e-8385-40e8863d34a8/cluster_bb11ac58-ef3b-5263-61be-56dba221e271/dfs/data/data2/current/BP-920763789-172.31.14.131-1689437449218] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-15 16:13:46,272 INFO [Listener at jenkins-hbase4.apache.org/38899] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-15 16:13:46,405 INFO [Listener at jenkins-hbase4.apache.org/38899] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-15 16:13:46,513 INFO [Listener at jenkins-hbase4.apache.org/38899] hbase.HBaseTestingUtility(1293): Minicluster is down