2023-09-14 04:00:57,507 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-14 04:00:57,708 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa 2023-09-14 04:00:57,709 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-14 04:00:57,709 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-14 04:00:57,748 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-14 04:00:57,990 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-14 04:00:57,990 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4, deleteOnExit=true 2023-09-14 04:00:57,991 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-14 04:00:57,991 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/test.cache.data in system properties and HBase conf 2023-09-14 04:00:57,991 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop.tmp.dir in system properties and HBase conf 2023-09-14 04:00:57,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop.log.dir in system properties and HBase conf 2023-09-14 04:00:57,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-14 04:00:57,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-14 04:00:57,993 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-14 04:00:58,322 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-14 04:00:58,327 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-14 04:00:58,327 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-14 04:00:58,328 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-14 04:00:58,328 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-14 04:00:58,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-14 04:00:58,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-14 04:00:58,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-14 04:00:58,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-14 04:00:58,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-14 04:00:58,331 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/nfs.dump.dir in system properties and HBase conf 2023-09-14 04:00:58,331 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir in system properties and HBase conf 2023-09-14 04:00:58,332 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-14 04:00:58,332 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-14 04:00:58,332 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-14 04:00:58,857 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-14 04:00:58,862 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-14 04:00:59,171 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-14 04:00:59,349 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-14 04:00:59,362 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 04:00:59,400 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 04:00:59,435 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir/Jetty_localhost_45665_hdfs____.7x17uq/webapp 2023-09-14 04:00:59,574 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45665 2023-09-14 04:00:59,613 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-14 04:00:59,614 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-14 04:01:00,070 WARN [Listener at localhost/43181] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-14 04:01:00,140 WARN [Listener at localhost/43181] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-14 04:01:00,160 WARN [Listener at localhost/43181] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 04:01:00,168 INFO [Listener at localhost/43181] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 04:01:00,174 INFO [Listener at localhost/43181] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir/Jetty_localhost_39721_datanode____.3b7tl5/webapp 2023-09-14 04:01:00,271 INFO [Listener at localhost/43181] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39721 2023-09-14 04:01:00,715 WARN [Listener at localhost/35901] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-14 04:01:00,727 WARN [Listener at localhost/35901] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-14 04:01:00,731 WARN [Listener at localhost/35901] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 04:01:00,733 INFO [Listener at localhost/35901] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 04:01:00,743 INFO [Listener at localhost/35901] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir/Jetty_localhost_45555_datanode____tim3bv/webapp 2023-09-14 04:01:00,843 INFO [Listener at localhost/35901] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45555 2023-09-14 04:01:00,853 WARN [Listener at localhost/38021] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-14 04:01:00,866 WARN [Listener at localhost/38021] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-14 04:01:00,871 WARN [Listener at localhost/38021] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 04:01:00,873 INFO [Listener at localhost/38021] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 04:01:00,882 INFO [Listener at localhost/38021] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir/Jetty_localhost_36743_datanode____.4epazq/webapp 2023-09-14 04:01:01,032 INFO [Listener at localhost/38021] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36743 2023-09-14 04:01:01,048 WARN [Listener at localhost/36207] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-14 04:01:01,385 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x82871d740ebf8f69: Processing first storage report for DS-b9246503-4b96-4461-b706-6588015d1897 from datanode b119bc37-5c4b-477e-987c-a1a5c3e5424f 2023-09-14 04:01:01,387 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x82871d740ebf8f69: from storage DS-b9246503-4b96-4461-b706-6588015d1897 node DatanodeRegistration(127.0.0.1:45541, datanodeUuid=b119bc37-5c4b-477e-987c-a1a5c3e5424f, infoPort=36313, infoSecurePort=0, ipcPort=36207, storageInfo=lv=-57;cid=testClusterID;nsid=1908145834;c=1694664058943), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-14 04:01:01,387 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf71e36071d003356: Processing first storage report for DS-162bb694-130c-4520-9215-c8c7d8a344b7 from datanode f00e1b47-036c-44ce-a71d-a7926febf9bf 2023-09-14 04:01:01,387 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf71e36071d003356: from storage DS-162bb694-130c-4520-9215-c8c7d8a344b7 node DatanodeRegistration(127.0.0.1:41349, datanodeUuid=f00e1b47-036c-44ce-a71d-a7926febf9bf, infoPort=37867, infoSecurePort=0, ipcPort=38021, storageInfo=lv=-57;cid=testClusterID;nsid=1908145834;c=1694664058943), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-14 04:01:01,388 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf94f599126bd3f4e: Processing first storage report for DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82 from datanode 77154a63-f206-47e0-9c6d-7428f7944371 2023-09-14 04:01:01,388 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf94f599126bd3f4e: from storage DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82 node DatanodeRegistration(127.0.0.1:41389, datanodeUuid=77154a63-f206-47e0-9c6d-7428f7944371, infoPort=44493, infoSecurePort=0, ipcPort=35901, storageInfo=lv=-57;cid=testClusterID;nsid=1908145834;c=1694664058943), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-14 04:01:01,388 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x82871d740ebf8f69: Processing first storage report for DS-3efe4b42-5e44-448d-8e1e-22b4499ea039 from datanode b119bc37-5c4b-477e-987c-a1a5c3e5424f 2023-09-14 04:01:01,388 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x82871d740ebf8f69: from storage DS-3efe4b42-5e44-448d-8e1e-22b4499ea039 node DatanodeRegistration(127.0.0.1:45541, datanodeUuid=b119bc37-5c4b-477e-987c-a1a5c3e5424f, infoPort=36313, infoSecurePort=0, ipcPort=36207, storageInfo=lv=-57;cid=testClusterID;nsid=1908145834;c=1694664058943), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-14 04:01:01,388 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf71e36071d003356: Processing first storage report for DS-1adec2ff-f4c5-43ce-bb61-c948afd2128c from datanode f00e1b47-036c-44ce-a71d-a7926febf9bf 2023-09-14 04:01:01,388 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf71e36071d003356: from storage DS-1adec2ff-f4c5-43ce-bb61-c948afd2128c node DatanodeRegistration(127.0.0.1:41349, datanodeUuid=f00e1b47-036c-44ce-a71d-a7926febf9bf, infoPort=37867, infoSecurePort=0, ipcPort=38021, storageInfo=lv=-57;cid=testClusterID;nsid=1908145834;c=1694664058943), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-14 04:01:01,388 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf94f599126bd3f4e: Processing first storage report for DS-14264aab-bcdf-4046-96e2-afa0179663f4 from datanode 77154a63-f206-47e0-9c6d-7428f7944371 2023-09-14 04:01:01,388 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf94f599126bd3f4e: from storage DS-14264aab-bcdf-4046-96e2-afa0179663f4 node DatanodeRegistration(127.0.0.1:41389, datanodeUuid=77154a63-f206-47e0-9c6d-7428f7944371, infoPort=44493, infoSecurePort=0, ipcPort=35901, storageInfo=lv=-57;cid=testClusterID;nsid=1908145834;c=1694664058943), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-14 04:01:01,563 DEBUG [Listener at localhost/36207] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa 2023-09-14 04:01:01,653 INFO [Listener at localhost/36207] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/zookeeper_0, clientPort=64527, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-14 04:01:01,672 INFO [Listener at localhost/36207] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64527 2023-09-14 04:01:01,679 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:01,681 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:02,369 INFO [Listener at localhost/36207] util.FSUtils(471): Created version file at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 with version=8 2023-09-14 04:01:02,369 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/hbase-staging 2023-09-14 04:01:02,714 INFO [Listener at localhost/36207] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-14 04:01:03,252 INFO [Listener at localhost/36207] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-14 04:01:03,285 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,285 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,286 INFO [Listener at localhost/36207] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-14 04:01:03,286 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,286 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-14 04:01:03,426 INFO [Listener at localhost/36207] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-14 04:01:03,499 DEBUG [Listener at localhost/36207] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-14 04:01:03,590 INFO [Listener at localhost/36207] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45157 2023-09-14 04:01:03,602 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:03,604 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:03,627 INFO [Listener at localhost/36207] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45157 connecting to ZooKeeper ensemble=127.0.0.1:64527 2023-09-14 04:01:03,689 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:451570x0, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-14 04:01:03,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45157-0x100a898aa680000 connected 2023-09-14 04:01:03,722 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 04:01:03,723 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 04:01:03,736 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-14 04:01:03,744 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45157 2023-09-14 04:01:03,744 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45157 2023-09-14 04:01:03,745 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45157 2023-09-14 04:01:03,745 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45157 2023-09-14 04:01:03,746 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45157 2023-09-14 04:01:03,752 INFO [Listener at localhost/36207] master.HMaster(444): hbase.rootdir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33, hbase.cluster.distributed=false 2023-09-14 04:01:03,819 INFO [Listener at localhost/36207] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-14 04:01:03,819 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,820 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,820 INFO [Listener at localhost/36207] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-14 04:01:03,820 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,820 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-14 04:01:03,825 INFO [Listener at localhost/36207] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-14 04:01:03,828 INFO [Listener at localhost/36207] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34905 2023-09-14 04:01:03,831 INFO [Listener at localhost/36207] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-14 04:01:03,838 INFO [Listener at localhost/36207] mob.MobFileCache(124): MobFileCache disabled 2023-09-14 04:01:03,839 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:03,842 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:03,844 INFO [Listener at localhost/36207] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34905 connecting to ZooKeeper ensemble=127.0.0.1:64527 2023-09-14 04:01:03,848 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:349050x0, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-14 04:01:03,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34905-0x100a898aa680001 connected 2023-09-14 04:01:03,849 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 04:01:03,851 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 04:01:03,852 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-14 04:01:03,852 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34905 2023-09-14 04:01:03,852 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34905 2023-09-14 04:01:03,853 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34905 2023-09-14 04:01:03,856 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34905 2023-09-14 04:01:03,856 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34905 2023-09-14 04:01:03,868 INFO [Listener at localhost/36207] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-14 04:01:03,869 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,869 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,869 INFO [Listener at localhost/36207] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-14 04:01:03,869 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,870 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-14 04:01:03,870 INFO [Listener at localhost/36207] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-14 04:01:03,871 INFO [Listener at localhost/36207] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39261 2023-09-14 04:01:03,871 INFO [Listener at localhost/36207] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-14 04:01:03,872 INFO [Listener at localhost/36207] mob.MobFileCache(124): MobFileCache disabled 2023-09-14 04:01:03,873 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:03,875 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:03,877 INFO [Listener at localhost/36207] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39261 connecting to ZooKeeper ensemble=127.0.0.1:64527 2023-09-14 04:01:03,882 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:392610x0, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-14 04:01:03,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39261-0x100a898aa680002 connected 2023-09-14 04:01:03,884 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 04:01:03,885 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 04:01:03,885 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-14 04:01:03,889 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39261 2023-09-14 04:01:03,889 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39261 2023-09-14 04:01:03,891 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39261 2023-09-14 04:01:03,892 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39261 2023-09-14 04:01:03,893 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39261 2023-09-14 04:01:03,905 INFO [Listener at localhost/36207] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-14 04:01:03,905 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,905 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,905 INFO [Listener at localhost/36207] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-14 04:01:03,905 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-14 04:01:03,905 INFO [Listener at localhost/36207] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-14 04:01:03,905 INFO [Listener at localhost/36207] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-14 04:01:03,908 INFO [Listener at localhost/36207] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39305 2023-09-14 04:01:03,909 INFO [Listener at localhost/36207] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-14 04:01:03,909 INFO [Listener at localhost/36207] mob.MobFileCache(124): MobFileCache disabled 2023-09-14 04:01:03,910 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:03,912 INFO [Listener at localhost/36207] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:03,913 INFO [Listener at localhost/36207] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39305 connecting to ZooKeeper ensemble=127.0.0.1:64527 2023-09-14 04:01:03,917 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:393050x0, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-14 04:01:03,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39305-0x100a898aa680003 connected 2023-09-14 04:01:03,918 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 04:01:03,919 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 04:01:03,919 DEBUG [Listener at localhost/36207] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-14 04:01:03,920 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39305 2023-09-14 04:01:03,921 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39305 2023-09-14 04:01:03,921 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39305 2023-09-14 04:01:03,921 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39305 2023-09-14 04:01:03,923 DEBUG [Listener at localhost/36207] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39305 2023-09-14 04:01:03,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:01:03,937 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-14 04:01:03,938 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:01:03,957 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-14 04:01:03,957 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-14 04:01:03,957 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-14 04:01:03,958 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:01:03,957 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-14 04:01:03,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-14 04:01:03,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45157,1694664062520 from backup master directory 2023-09-14 04:01:03,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-14 04:01:03,966 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:01:03,966 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-14 04:01:03,967 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-14 04:01:03,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:01:03,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-14 04:01:03,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-14 04:01:04,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/hbase.id with ID: 2a4882f6-bcee-4c19-aa41-a4a1ae87000f 2023-09-14 04:01:04,135 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-14 04:01:04,150 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:01:04,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2ade707b to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:04,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e0db9bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:04,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-14 04:01:04,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-14 04:01:04,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-14 04:01:04,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-14 04:01:04,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-14 04:01:04,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-14 04:01:04,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 04:01:04,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/data/master/store-tmp 2023-09-14 04:01:04,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:04,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-14 04:01:04,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 04:01:04,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 04:01:04,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-14 04:01:04,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 04:01:04,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 04:01:04,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-14 04:01:04,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/WALs/jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:01:04,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45157%2C1694664062520, suffix=, logDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/WALs/jenkins-hbase4.apache.org,45157,1694664062520, archiveDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/oldWALs, maxLogs=10 2023-09-14 04:01:04,468 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK] 2023-09-14 04:01:04,468 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK] 2023-09-14 04:01:04,468 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK] 2023-09-14 04:01:04,476 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-14 04:01:04,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/WALs/jenkins-hbase4.apache.org,45157,1694664062520/jenkins-hbase4.apache.org%2C45157%2C1694664062520.1694664064418 2023-09-14 04:01:04,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK], DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK], DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK]] 2023-09-14 04:01:04,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-14 04:01:04,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:04,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-14 04:01:04,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-14 04:01:04,631 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-14 04:01:04,639 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-14 04:01:04,670 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-14 04:01:04,684 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:04,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-14 04:01:04,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-14 04:01:04,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-14 04:01:04,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:04,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72801167, jitterRate=0.0848219245672226}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:01:04,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-14 04:01:04,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-14 04:01:04,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-14 04:01:04,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-14 04:01:04,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-14 04:01:04,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-14 04:01:04,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 35 msec 2023-09-14 04:01:04,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-14 04:01:04,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-14 04:01:04,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-14 04:01:04,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-14 04:01:04,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-14 04:01:04,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-14 04:01:04,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-14 04:01:04,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-14 04:01:04,856 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:01:04,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-14 04:01:04,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-14 04:01:04,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-14 04:01:04,877 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-14 04:01:04,878 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-14 04:01:04,877 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-14 04:01:04,877 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-14 04:01:04,878 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:01:04,878 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45157,1694664062520, sessionid=0x100a898aa680000, setting cluster-up flag (Was=false) 2023-09-14 04:01:04,897 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:01:04,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-14 04:01:04,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:01:04,912 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:01:04,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-14 04:01:04,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:01:04,921 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp 2023-09-14 04:01:04,927 INFO [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(951): ClusterId : 2a4882f6-bcee-4c19-aa41-a4a1ae87000f 2023-09-14 04:01:04,927 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(951): ClusterId : 2a4882f6-bcee-4c19-aa41-a4a1ae87000f 2023-09-14 04:01:04,928 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(951): ClusterId : 2a4882f6-bcee-4c19-aa41-a4a1ae87000f 2023-09-14 04:01:04,934 DEBUG [RS:1;jenkins-hbase4:39261] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-14 04:01:04,934 DEBUG [RS:0;jenkins-hbase4:34905] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-14 04:01:04,934 DEBUG [RS:2;jenkins-hbase4:39305] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-14 04:01:04,941 DEBUG [RS:2;jenkins-hbase4:39305] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-14 04:01:04,941 DEBUG [RS:0;jenkins-hbase4:34905] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-14 04:01:04,941 DEBUG [RS:1;jenkins-hbase4:39261] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-14 04:01:04,942 DEBUG [RS:0;jenkins-hbase4:34905] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-14 04:01:04,941 DEBUG [RS:2;jenkins-hbase4:39305] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-14 04:01:04,942 DEBUG [RS:1;jenkins-hbase4:39261] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-14 04:01:04,946 DEBUG [RS:1;jenkins-hbase4:39261] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-14 04:01:04,946 DEBUG [RS:2;jenkins-hbase4:39305] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-14 04:01:04,946 DEBUG [RS:0;jenkins-hbase4:34905] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-14 04:01:04,950 DEBUG [RS:1;jenkins-hbase4:39261] zookeeper.ReadOnlyZKClient(139): Connect 0x13f3c187 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:04,950 DEBUG [RS:2;jenkins-hbase4:39305] zookeeper.ReadOnlyZKClient(139): Connect 0x7de28631 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:04,951 DEBUG [RS:0;jenkins-hbase4:34905] zookeeper.ReadOnlyZKClient(139): Connect 0x048344f7 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:04,965 DEBUG [RS:1;jenkins-hbase4:39261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d342d89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:04,966 DEBUG [RS:0;jenkins-hbase4:34905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a44ba17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:04,966 DEBUG [RS:1;jenkins-hbase4:39261] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@190baaf7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-14 04:01:04,966 DEBUG [RS:0;jenkins-hbase4:34905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e7b2f87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-14 04:01:04,966 DEBUG [RS:2;jenkins-hbase4:39305] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@732577fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:04,966 DEBUG [RS:2;jenkins-hbase4:39305] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@771aed41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-14 04:01:04,992 DEBUG [RS:0;jenkins-hbase4:34905] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34905 2023-09-14 04:01:04,994 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39261 2023-09-14 04:01:04,996 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39305 2023-09-14 04:01:04,997 INFO [RS:0;jenkins-hbase4:34905] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-14 04:01:04,997 INFO [RS:1;jenkins-hbase4:39261] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-14 04:01:04,997 INFO [RS:0;jenkins-hbase4:34905] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-14 04:01:04,997 INFO [RS:2;jenkins-hbase4:39305] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-14 04:01:04,998 INFO [RS:2;jenkins-hbase4:39305] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-14 04:01:04,998 INFO [RS:1;jenkins-hbase4:39261] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-14 04:01:05,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-14 04:01:05,020 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-14 04:01:05,020 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-14 04:01:05,020 DEBUG [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-14 04:01:05,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:05,022 INFO [RS:0;jenkins-hbase4:34905] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:05,022 INFO [RS:2;jenkins-hbase4:39305] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:05,023 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1022): About to register with Master. 2023-09-14 04:01:05,022 INFO [RS:1;jenkins-hbase4:39261] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:05,023 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1022): About to register with Master. 2023-09-14 04:01:05,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-14 04:01:05,023 DEBUG [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1022): About to register with Master. 2023-09-14 04:01:05,026 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45157,1694664062520 with isa=jenkins-hbase4.apache.org/172.31.14.131:39305, startcode=1694664063904 2023-09-14 04:01:05,026 INFO [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45157,1694664062520 with isa=jenkins-hbase4.apache.org/172.31.14.131:34905, startcode=1694664063818 2023-09-14 04:01:05,026 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45157,1694664062520 with isa=jenkins-hbase4.apache.org/172.31.14.131:39261, startcode=1694664063868 2023-09-14 04:01:05,045 DEBUG [RS:1;jenkins-hbase4:39261] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-14 04:01:05,045 DEBUG [RS:0;jenkins-hbase4:34905] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-14 04:01:05,045 DEBUG [RS:2;jenkins-hbase4:39305] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-14 04:01:05,118 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39213, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-14 04:01:05,118 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46877, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-14 04:01:05,118 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58569, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-14 04:01:05,128 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45157] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-14 04:01:05,136 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45157] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-14 04:01:05,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-14 04:01:05,137 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45157] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-14 04:01:05,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-14 04:01:05,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-14 04:01:05,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-14 04:01:05,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-14 04:01:05,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-14 04:01:05,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-14 04:01:05,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694664095152 2023-09-14 04:01:05,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-14 04:01:05,157 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-14 04:01:05,157 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-14 04:01:05,159 DEBUG [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(2830): Master is not running yet 2023-09-14 04:01:05,159 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(2830): Master is not running yet 2023-09-14 04:01:05,159 WARN [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-14 04:01:05,159 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(2830): Master is not running yet 2023-09-14 04:01:05,159 WARN [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-14 04:01:05,160 WARN [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-14 04:01:05,162 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-14 04:01:05,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-14 04:01:05,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-14 04:01:05,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-14 04:01:05,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-14 04:01:05,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-14 04:01:05,173 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-14 04:01:05,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-14 04:01:05,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-14 04:01:05,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-14 04:01:05,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-14 04:01:05,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694664065183,5,FailOnTimeoutGroup] 2023-09-14 04:01:05,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694664065183,5,FailOnTimeoutGroup] 2023-09-14 04:01:05,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-14 04:01:05,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,206 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-14 04:01:05,207 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-14 04:01:05,207 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:05,232 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:05,234 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-14 04:01:05,237 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/info 2023-09-14 04:01:05,237 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-14 04:01:05,238 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:05,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-14 04:01:05,241 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/rep_barrier 2023-09-14 04:01:05,242 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-14 04:01:05,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:05,243 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-14 04:01:05,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/table 2023-09-14 04:01:05,245 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-14 04:01:05,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:05,247 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740 2023-09-14 04:01:05,248 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740 2023-09-14 04:01:05,252 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-14 04:01:05,254 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-14 04:01:05,258 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:05,259 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62278876, jitterRate=-0.07197242975234985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-14 04:01:05,259 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-14 04:01:05,260 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-14 04:01:05,260 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-14 04:01:05,260 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-14 04:01:05,260 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-14 04:01:05,260 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-14 04:01:05,261 INFO [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45157,1694664062520 with isa=jenkins-hbase4.apache.org/172.31.14.131:34905, startcode=1694664063818 2023-09-14 04:01:05,261 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45157,1694664062520 with isa=jenkins-hbase4.apache.org/172.31.14.131:39305, startcode=1694664063904 2023-09-14 04:01:05,261 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45157,1694664062520 with isa=jenkins-hbase4.apache.org/172.31.14.131:39261, startcode=1694664063868 2023-09-14 04:01:05,270 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-14 04:01:05,270 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-14 04:01:05,276 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45157] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:05,281 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-14 04:01:05,281 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-14 04:01:05,284 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45157] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:05,285 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:05,285 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43181 2023-09-14 04:01:05,285 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-14 04:01:05,289 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45157] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:05,292 DEBUG [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:05,292 DEBUG [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43181 2023-09-14 04:01:05,292 DEBUG [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-14 04:01:05,293 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:05,293 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 04:01:05,293 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43181 2023-09-14 04:01:05,294 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-14 04:01:05,299 DEBUG [RS:2;jenkins-hbase4:39305] zookeeper.ZKUtil(162): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:05,299 WARN [RS:2;jenkins-hbase4:39305] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-14 04:01:05,299 INFO [RS:2;jenkins-hbase4:39305] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 04:01:05,299 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:05,300 DEBUG [RS:0;jenkins-hbase4:34905] zookeeper.ZKUtil(162): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:05,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-14 04:01:05,302 DEBUG [RS:1;jenkins-hbase4:39261] zookeeper.ZKUtil(162): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:05,301 WARN [RS:0;jenkins-hbase4:34905] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-14 04:01:05,302 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39305,1694664063904] 2023-09-14 04:01:05,304 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34905,1694664063818] 2023-09-14 04:01:05,304 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39261,1694664063868] 2023-09-14 04:01:05,302 WARN [RS:1;jenkins-hbase4:39261] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-14 04:01:05,305 INFO [RS:1;jenkins-hbase4:39261] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 04:01:05,305 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:05,303 INFO [RS:0;jenkins-hbase4:34905] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 04:01:05,306 DEBUG [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:05,323 DEBUG [RS:1;jenkins-hbase4:39261] zookeeper.ZKUtil(162): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:05,324 DEBUG [RS:1;jenkins-hbase4:39261] zookeeper.ZKUtil(162): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:05,324 DEBUG [RS:0;jenkins-hbase4:34905] zookeeper.ZKUtil(162): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:05,325 DEBUG [RS:1;jenkins-hbase4:39261] zookeeper.ZKUtil(162): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:05,325 DEBUG [RS:2;jenkins-hbase4:39305] zookeeper.ZKUtil(162): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:05,326 DEBUG [RS:0;jenkins-hbase4:34905] zookeeper.ZKUtil(162): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:05,326 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-14 04:01:05,327 DEBUG [RS:0;jenkins-hbase4:34905] zookeeper.ZKUtil(162): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:05,327 DEBUG [RS:2;jenkins-hbase4:39305] zookeeper.ZKUtil(162): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:05,328 DEBUG [RS:2;jenkins-hbase4:39305] zookeeper.ZKUtil(162): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:05,328 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-14 04:01:05,342 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-14 04:01:05,342 DEBUG [RS:0;jenkins-hbase4:34905] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-14 04:01:05,342 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-14 04:01:05,353 INFO [RS:1;jenkins-hbase4:39261] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-14 04:01:05,353 INFO [RS:0;jenkins-hbase4:34905] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-14 04:01:05,353 INFO [RS:2;jenkins-hbase4:39305] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-14 04:01:05,375 INFO [RS:2;jenkins-hbase4:39305] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-14 04:01:05,375 INFO [RS:1;jenkins-hbase4:39261] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-14 04:01:05,375 INFO [RS:0;jenkins-hbase4:34905] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-14 04:01:05,380 INFO [RS:2;jenkins-hbase4:39305] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-14 04:01:05,380 INFO [RS:1;jenkins-hbase4:39261] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-14 04:01:05,380 INFO [RS:2;jenkins-hbase4:39305] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,380 INFO [RS:0;jenkins-hbase4:34905] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-14 04:01:05,381 INFO [RS:1;jenkins-hbase4:39261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,381 INFO [RS:0;jenkins-hbase4:34905] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,381 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-14 04:01:05,382 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-14 04:01:05,382 INFO [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-14 04:01:05,391 INFO [RS:1;jenkins-hbase4:39261] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,391 INFO [RS:2;jenkins-hbase4:39305] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,391 INFO [RS:0;jenkins-hbase4:34905] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,391 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,392 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-14 04:01:05,393 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-14 04:01:05,393 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:2;jenkins-hbase4:39305] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:0;jenkins-hbase4:34905] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,393 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,394 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,394 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-14 04:01:05,394 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,395 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,395 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,395 INFO [RS:2;jenkins-hbase4:39305] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,395 DEBUG [RS:1;jenkins-hbase4:39261] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-14 04:01:05,395 INFO [RS:2;jenkins-hbase4:39305] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,395 INFO [RS:2;jenkins-hbase4:39305] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,397 INFO [RS:0;jenkins-hbase4:34905] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,397 INFO [RS:0;jenkins-hbase4:34905] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,398 INFO [RS:0;jenkins-hbase4:34905] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,401 INFO [RS:1;jenkins-hbase4:39261] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,401 INFO [RS:1;jenkins-hbase4:39261] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,401 INFO [RS:1;jenkins-hbase4:39261] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,417 INFO [RS:2;jenkins-hbase4:39305] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-14 04:01:05,417 INFO [RS:1;jenkins-hbase4:39261] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-14 04:01:05,419 INFO [RS:0;jenkins-hbase4:34905] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-14 04:01:05,422 INFO [RS:1;jenkins-hbase4:39261] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39261,1694664063868-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,422 INFO [RS:0;jenkins-hbase4:34905] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34905,1694664063818-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,423 INFO [RS:2;jenkins-hbase4:39305] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39305,1694664063904-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:05,447 INFO [RS:1;jenkins-hbase4:39261] regionserver.Replication(203): jenkins-hbase4.apache.org,39261,1694664063868 started 2023-09-14 04:01:05,447 INFO [RS:2;jenkins-hbase4:39305] regionserver.Replication(203): jenkins-hbase4.apache.org,39305,1694664063904 started 2023-09-14 04:01:05,448 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39261,1694664063868, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39261, sessionid=0x100a898aa680002 2023-09-14 04:01:05,448 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39305,1694664063904, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39305, sessionid=0x100a898aa680003 2023-09-14 04:01:05,449 INFO [RS:0;jenkins-hbase4:34905] regionserver.Replication(203): jenkins-hbase4.apache.org,34905,1694664063818 started 2023-09-14 04:01:05,449 DEBUG [RS:2;jenkins-hbase4:39305] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-14 04:01:05,449 INFO [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34905,1694664063818, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34905, sessionid=0x100a898aa680001 2023-09-14 04:01:05,449 DEBUG [RS:1;jenkins-hbase4:39261] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-14 04:01:05,449 DEBUG [RS:0;jenkins-hbase4:34905] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-14 04:01:05,449 DEBUG [RS:1;jenkins-hbase4:39261] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:05,449 DEBUG [RS:2;jenkins-hbase4:39305] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:05,450 DEBUG [RS:1;jenkins-hbase4:39261] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39261,1694664063868' 2023-09-14 04:01:05,450 DEBUG [RS:0;jenkins-hbase4:34905] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:05,451 DEBUG [RS:1;jenkins-hbase4:39261] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-14 04:01:05,450 DEBUG [RS:2;jenkins-hbase4:39305] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39305,1694664063904' 2023-09-14 04:01:05,451 DEBUG [RS:0;jenkins-hbase4:34905] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34905,1694664063818' 2023-09-14 04:01:05,451 DEBUG [RS:2;jenkins-hbase4:39305] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-14 04:01:05,452 DEBUG [RS:0;jenkins-hbase4:34905] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-14 04:01:05,452 DEBUG [RS:1;jenkins-hbase4:39261] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-14 04:01:05,452 DEBUG [RS:2;jenkins-hbase4:39305] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-14 04:01:05,452 DEBUG [RS:0;jenkins-hbase4:34905] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-14 04:01:05,453 DEBUG [RS:1;jenkins-hbase4:39261] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-14 04:01:05,453 DEBUG [RS:1;jenkins-hbase4:39261] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-14 04:01:05,453 DEBUG [RS:1;jenkins-hbase4:39261] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:05,453 DEBUG [RS:1;jenkins-hbase4:39261] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39261,1694664063868' 2023-09-14 04:01:05,453 DEBUG [RS:1;jenkins-hbase4:39261] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:05,453 DEBUG [RS:2;jenkins-hbase4:39305] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-14 04:01:05,453 DEBUG [RS:0;jenkins-hbase4:34905] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-14 04:01:05,454 DEBUG [RS:1;jenkins-hbase4:39261] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:05,454 DEBUG [RS:0;jenkins-hbase4:34905] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-14 04:01:05,454 DEBUG [RS:2;jenkins-hbase4:39305] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-14 04:01:05,455 DEBUG [RS:2;jenkins-hbase4:39305] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:05,454 DEBUG [RS:0;jenkins-hbase4:34905] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:05,455 DEBUG [RS:2;jenkins-hbase4:39305] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39305,1694664063904' 2023-09-14 04:01:05,455 DEBUG [RS:1;jenkins-hbase4:39261] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-14 04:01:05,455 DEBUG [RS:0;jenkins-hbase4:34905] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34905,1694664063818' 2023-09-14 04:01:05,455 DEBUG [RS:0;jenkins-hbase4:34905] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:05,455 INFO [RS:1;jenkins-hbase4:39261] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-14 04:01:05,455 INFO [RS:1;jenkins-hbase4:39261] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-14 04:01:05,455 DEBUG [RS:2;jenkins-hbase4:39305] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:05,456 DEBUG [RS:0;jenkins-hbase4:34905] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:05,456 DEBUG [RS:2;jenkins-hbase4:39305] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:05,457 DEBUG [RS:0;jenkins-hbase4:34905] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-14 04:01:05,457 INFO [RS:0;jenkins-hbase4:34905] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-14 04:01:05,458 DEBUG [RS:2;jenkins-hbase4:39305] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-14 04:01:05,458 INFO [RS:0;jenkins-hbase4:34905] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-14 04:01:05,458 INFO [RS:2;jenkins-hbase4:39305] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-14 04:01:05,458 INFO [RS:2;jenkins-hbase4:39305] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-14 04:01:05,481 DEBUG [jenkins-hbase4:45157] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-14 04:01:05,487 DEBUG [jenkins-hbase4:45157] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:01:05,495 DEBUG [jenkins-hbase4:45157] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:01:05,495 DEBUG [jenkins-hbase4:45157] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:01:05,495 DEBUG [jenkins-hbase4:45157] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:01:05,495 DEBUG [jenkins-hbase4:45157] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:01:05,498 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39261,1694664063868, state=OPENING 2023-09-14 04:01:05,506 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-14 04:01:05,507 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:01:05,508 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-14 04:01:05,512 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:01:05,566 INFO [RS:1;jenkins-hbase4:39261] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39261%2C1694664063868, suffix=, logDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,39261,1694664063868, archiveDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/oldWALs, maxLogs=32 2023-09-14 04:01:05,567 INFO [RS:2;jenkins-hbase4:39305] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39305%2C1694664063904, suffix=, logDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,39305,1694664063904, archiveDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/oldWALs, maxLogs=32 2023-09-14 04:01:05,566 INFO [RS:0;jenkins-hbase4:34905] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34905%2C1694664063818, suffix=, logDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,34905,1694664063818, archiveDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/oldWALs, maxLogs=32 2023-09-14 04:01:05,593 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK] 2023-09-14 04:01:05,593 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK] 2023-09-14 04:01:05,593 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK] 2023-09-14 04:01:05,594 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK] 2023-09-14 04:01:05,594 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK] 2023-09-14 04:01:05,595 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK] 2023-09-14 04:01:05,607 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK] 2023-09-14 04:01:05,607 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK] 2023-09-14 04:01:05,607 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK] 2023-09-14 04:01:05,617 INFO [RS:2;jenkins-hbase4:39305] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,39305,1694664063904/jenkins-hbase4.apache.org%2C39305%2C1694664063904.1694664065571 2023-09-14 04:01:05,617 INFO [RS:1;jenkins-hbase4:39261] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,39261,1694664063868/jenkins-hbase4.apache.org%2C39261%2C1694664063868.1694664065571 2023-09-14 04:01:05,618 DEBUG [RS:2;jenkins-hbase4:39305] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK], DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK], DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK]] 2023-09-14 04:01:05,619 DEBUG [RS:1;jenkins-hbase4:39261] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK], DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK], DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK]] 2023-09-14 04:01:05,619 INFO [RS:0;jenkins-hbase4:34905] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,34905,1694664063818/jenkins-hbase4.apache.org%2C34905%2C1694664063818.1694664065571 2023-09-14 04:01:05,621 DEBUG [RS:0;jenkins-hbase4:34905] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK], DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK], DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK]] 2023-09-14 04:01:05,698 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:05,700 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 04:01:05,703 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 04:01:05,716 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-14 04:01:05,717 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-14 04:01:05,721 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39261%2C1694664063868.meta, suffix=.meta, logDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,39261,1694664063868, archiveDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/oldWALs, maxLogs=32 2023-09-14 04:01:05,740 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK] 2023-09-14 04:01:05,742 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK] 2023-09-14 04:01:05,748 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK] 2023-09-14 04:01:05,759 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/WALs/jenkins-hbase4.apache.org,39261,1694664063868/jenkins-hbase4.apache.org%2C39261%2C1694664063868.meta.1694664065722.meta 2023-09-14 04:01:05,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45541,DS-b9246503-4b96-4461-b706-6588015d1897,DISK], DatanodeInfoWithStorage[127.0.0.1:41389,DS-4eea71b0-c0b2-4f9c-a99c-c5e670916d82,DISK], DatanodeInfoWithStorage[127.0.0.1:41349,DS-162bb694-130c-4520-9215-c8c7d8a344b7,DISK]] 2023-09-14 04:01:05,760 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-14 04:01:05,761 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-14 04:01:05,763 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:05,763 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-14 04:01:05,766 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-14 04:01:05,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-14 04:01:05,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-14 04:01:05,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:05,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-14 04:01:05,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-14 04:01:05,784 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-14 04:01:05,785 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/info 2023-09-14 04:01:05,785 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/info 2023-09-14 04:01:05,786 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-14 04:01:05,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:05,787 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-14 04:01:05,788 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/rep_barrier 2023-09-14 04:01:05,788 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/rep_barrier 2023-09-14 04:01:05,789 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-14 04:01:05,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:05,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-14 04:01:05,791 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/table 2023-09-14 04:01:05,792 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/table 2023-09-14 04:01:05,792 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-14 04:01:05,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:05,795 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740 2023-09-14 04:01:05,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740 2023-09-14 04:01:05,803 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-14 04:01:05,805 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-14 04:01:05,807 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61125491, jitterRate=-0.08915920555591583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-14 04:01:05,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-14 04:01:05,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694664065690 2023-09-14 04:01:05,838 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-14 04:01:05,839 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-14 04:01:05,840 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39261,1694664063868, state=OPEN 2023-09-14 04:01:05,844 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-14 04:01:05,844 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-14 04:01:05,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-14 04:01:05,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39261,1694664063868 in 332 msec 2023-09-14 04:01:05,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-14 04:01:05,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 551 msec 2023-09-14 04:01:05,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 834 msec 2023-09-14 04:01:05,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694664065867, completionTime=-1 2023-09-14 04:01:05,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-14 04:01:05,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-14 04:01:05,935 DEBUG [hconnection-0x61de7c9e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:05,938 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:05,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-14 04:01:05,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694664125994 2023-09-14 04:01:05,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694664185994 2023-09-14 04:01:05,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 126 msec 2023-09-14 04:01:06,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45157,1694664062520-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:06,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45157,1694664062520-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:06,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45157,1694664062520-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:06,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45157, period=300000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:06,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-14 04:01:06,027 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-14 04:01:06,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-14 04:01:06,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-14 04:01:06,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-14 04:01:06,047 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 04:01:06,050 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 04:01:06,073 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:01:06,075 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321 empty. 2023-09-14 04:01:06,076 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:01:06,076 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-14 04:01:06,116 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-14 04:01:06,118 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e456812d7bb6ae4e34aa5d52586de321, NAME => 'hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:01:06,141 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:06,141 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e456812d7bb6ae4e34aa5d52586de321, disabling compactions & flushes 2023-09-14 04:01:06,141 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:01:06,141 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:01:06,141 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. after waiting 0 ms 2023-09-14 04:01:06,141 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:01:06,142 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:01:06,142 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e456812d7bb6ae4e34aa5d52586de321: 2023-09-14 04:01:06,146 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 04:01:06,160 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694664066149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664066149"}]},"ts":"1694664066149"} 2023-09-14 04:01:06,186 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-14 04:01:06,189 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 04:01:06,195 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664066189"}]},"ts":"1694664066189"} 2023-09-14 04:01:06,199 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-14 04:01:06,204 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:01:06,206 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:01:06,206 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:01:06,206 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:01:06,206 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:01:06,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e456812d7bb6ae4e34aa5d52586de321, ASSIGN}] 2023-09-14 04:01:06,212 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e456812d7bb6ae4e34aa5d52586de321, ASSIGN 2023-09-14 04:01:06,213 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e456812d7bb6ae4e34aa5d52586de321, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39305,1694664063904; forceNewPlan=false, retain=false 2023-09-14 04:01:06,366 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-14 04:01:06,367 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e456812d7bb6ae4e34aa5d52586de321, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:06,367 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694664066367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664066367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664066367"}]},"ts":"1694664066367"} 2023-09-14 04:01:06,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e456812d7bb6ae4e34aa5d52586de321, server=jenkins-hbase4.apache.org,39305,1694664063904}] 2023-09-14 04:01:06,526 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:06,526 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 04:01:06,529 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 04:01:06,536 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:01:06,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e456812d7bb6ae4e34aa5d52586de321, NAME => 'hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321.', STARTKEY => '', ENDKEY => ''} 2023-09-14 04:01:06,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. service=AccessControlService 2023-09-14 04:01:06,538 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:06,538 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:01:06,538 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:06,539 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:01:06,539 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:01:06,541 INFO [StoreOpener-e456812d7bb6ae4e34aa5d52586de321-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:01:06,543 DEBUG [StoreOpener-e456812d7bb6ae4e34aa5d52586de321-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321/info 2023-09-14 04:01:06,543 DEBUG [StoreOpener-e456812d7bb6ae4e34aa5d52586de321-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321/info 2023-09-14 04:01:06,544 INFO [StoreOpener-e456812d7bb6ae4e34aa5d52586de321-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e456812d7bb6ae4e34aa5d52586de321 columnFamilyName info 2023-09-14 04:01:06,545 INFO [StoreOpener-e456812d7bb6ae4e34aa5d52586de321-1] regionserver.HStore(310): Store=e456812d7bb6ae4e34aa5d52586de321/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:06,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:01:06,547 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:01:06,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:01:06,556 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:06,557 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e456812d7bb6ae4e34aa5d52586de321; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72855938, jitterRate=0.08563807606697083}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:01:06,557 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e456812d7bb6ae4e34aa5d52586de321: 2023-09-14 04:01:06,559 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321., pid=6, masterSystemTime=1694664066526 2023-09-14 04:01:06,564 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:01:06,564 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:01:06,566 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e456812d7bb6ae4e34aa5d52586de321, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:06,566 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694664066565"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664066565"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664066565"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664066565"}]},"ts":"1694664066565"} 2023-09-14 04:01:06,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-14 04:01:06,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e456812d7bb6ae4e34aa5d52586de321, server=jenkins-hbase4.apache.org,39305,1694664063904 in 198 msec 2023-09-14 04:01:06,577 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-14 04:01:06,578 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e456812d7bb6ae4e34aa5d52586de321, ASSIGN in 365 msec 2023-09-14 04:01:06,579 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 04:01:06,579 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664066579"}]},"ts":"1694664066579"} 2023-09-14 04:01:06,581 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-14 04:01:06,585 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 04:01:06,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 548 msec 2023-09-14 04:01:06,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-14 04:01:06,649 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-14 04:01:06,650 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:01:06,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:06,672 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:06,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-14 04:01:06,700 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-14 04:01:06,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-09-14 04:01:06,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-14 04:01:06,729 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-14 04:01:06,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-14 04:01:06,744 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-14 04:01:06,747 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-14 04:01:06,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.781sec 2023-09-14 04:01:06,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-14 04:01:06,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-14 04:01:06,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-14 04:01:06,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45157,1694664062520-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-14 04:01:06,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45157,1694664062520-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-14 04:01:06,775 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-14 04:01:06,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-14 04:01:06,779 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 04:01:06,780 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 04:01:06,783 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/hbase/acl/ae125d1557f9e81696148917eee0f932 2023-09-14 04:01:06,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-14 04:01:06,783 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/hbase/acl/ae125d1557f9e81696148917eee0f932 empty. 2023-09-14 04:01:06,786 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/hbase/acl/ae125d1557f9e81696148917eee0f932 2023-09-14 04:01:06,786 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-14 04:01:06,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-14 04:01:06,808 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-14 04:01:06,810 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ae125d1557f9e81696148917eee0f932, NAME => 'hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:01:06,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:06,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ae125d1557f9e81696148917eee0f932, disabling compactions & flushes 2023-09-14 04:01:06,832 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:01:06,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:01:06,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. after waiting 0 ms 2023-09-14 04:01:06,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:01:06,833 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:01:06,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ae125d1557f9e81696148917eee0f932: 2023-09-14 04:01:06,838 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 04:01:06,838 DEBUG [Listener at localhost/36207] zookeeper.ReadOnlyZKClient(139): Connect 0x198b16b9 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:06,840 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694664066840"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664066840"}]},"ts":"1694664066840"} 2023-09-14 04:01:06,843 DEBUG [Listener at localhost/36207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@435d5692, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:06,843 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-14 04:01:06,847 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 04:01:06,847 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664066847"}]},"ts":"1694664066847"} 2023-09-14 04:01:06,851 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-14 04:01:06,857 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:01:06,858 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:01:06,858 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:01:06,858 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:01:06,858 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:01:06,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ae125d1557f9e81696148917eee0f932, ASSIGN}] 2023-09-14 04:01:06,858 DEBUG [hconnection-0x162add54-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:06,860 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ae125d1557f9e81696148917eee0f932, ASSIGN 2023-09-14 04:01:06,862 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ae125d1557f9e81696148917eee0f932, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39305,1694664063904; forceNewPlan=false, retain=false 2023-09-14 04:01:06,870 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/test.cache.data in system properties and HBase conf 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop.tmp.dir in system properties and HBase conf 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop.log.dir in system properties and HBase conf 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-14 04:01:06,873 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/nfs.dump.dir in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-14 04:01:06,874 INFO [Listener at localhost/36207] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-14 04:01:06,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-14 04:01:07,012 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-14 04:01:07,013 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ae125d1557f9e81696148917eee0f932, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:07,014 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694664067013"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664067013"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664067013"}]},"ts":"1694664067013"} 2023-09-14 04:01:07,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ae125d1557f9e81696148917eee0f932, server=jenkins-hbase4.apache.org,39305,1694664063904}] 2023-09-14 04:01:07,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-14 04:01:07,177 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:01:07,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae125d1557f9e81696148917eee0f932, NAME => 'hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932.', STARTKEY => '', ENDKEY => ''} 2023-09-14 04:01:07,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. service=AccessControlService 2023-09-14 04:01:07,178 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:07,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ae125d1557f9e81696148917eee0f932 2023-09-14 04:01:07,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:07,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ae125d1557f9e81696148917eee0f932 2023-09-14 04:01:07,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ae125d1557f9e81696148917eee0f932 2023-09-14 04:01:07,180 INFO [StoreOpener-ae125d1557f9e81696148917eee0f932-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ae125d1557f9e81696148917eee0f932 2023-09-14 04:01:07,182 DEBUG [StoreOpener-ae125d1557f9e81696148917eee0f932-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932/l 2023-09-14 04:01:07,182 DEBUG [StoreOpener-ae125d1557f9e81696148917eee0f932-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932/l 2023-09-14 04:01:07,182 INFO [StoreOpener-ae125d1557f9e81696148917eee0f932-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae125d1557f9e81696148917eee0f932 columnFamilyName l 2023-09-14 04:01:07,183 INFO [StoreOpener-ae125d1557f9e81696148917eee0f932-1] regionserver.HStore(310): Store=ae125d1557f9e81696148917eee0f932/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:07,185 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932 2023-09-14 04:01:07,186 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932 2023-09-14 04:01:07,190 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ae125d1557f9e81696148917eee0f932 2023-09-14 04:01:07,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:07,194 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ae125d1557f9e81696148917eee0f932; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66105538, jitterRate=-0.014950722455978394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:01:07,194 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ae125d1557f9e81696148917eee0f932: 2023-09-14 04:01:07,195 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932., pid=11, masterSystemTime=1694664067171 2023-09-14 04:01:07,198 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:01:07,199 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:01:07,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ae125d1557f9e81696148917eee0f932, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:07,200 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694664067199"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664067199"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664067199"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664067199"}]},"ts":"1694664067199"} 2023-09-14 04:01:07,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-14 04:01:07,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ae125d1557f9e81696148917eee0f932, server=jenkins-hbase4.apache.org,39305,1694664063904 in 186 msec 2023-09-14 04:01:07,210 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-14 04:01:07,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ae125d1557f9e81696148917eee0f932, ASSIGN in 348 msec 2023-09-14 04:01:07,212 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 04:01:07,212 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664067212"}]},"ts":"1694664067212"} 2023-09-14 04:01:07,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-14 04:01:07,219 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 04:01:07,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 444 msec 2023-09-14 04:01:07,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-14 04:01:07,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-14 04:01:07,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-14 04:01:07,983 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 04:01:08,357 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 04:01:08,364 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41091_jobhistory____.e4ycfg/webapp 2023-09-14 04:01:08,528 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-14 04:01:08,528 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-14 04:01:08,528 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-14 04:01:08,532 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-14 04:01:08,620 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:08,948 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:09,324 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-14 04:01:09,402 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41091 2023-09-14 04:01:09,478 WARN [Listener at jenkins-hbase4.apache.org/32789] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 04:01:09,731 WARN [Listener at jenkins-hbase4.apache.org/32789] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-14 04:01:09,732 INFO [Listener at jenkins-hbase4.apache.org/32789] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 04:01:09,739 INFO [Listener at jenkins-hbase4.apache.org/32789] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39277_cluster____lvapx4/webapp 2023-09-14 04:01:09,814 INFO [Listener at jenkins-hbase4.apache.org/32789] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-14 04:01:09,815 INFO [Listener at jenkins-hbase4.apache.org/32789] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-14 04:01:09,815 INFO [Listener at jenkins-hbase4.apache.org/32789] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-14 04:01:09,815 INFO [Listener at jenkins-hbase4.apache.org/32789] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-14 04:01:09,825 INFO [Listener at jenkins-hbase4.apache.org/32789] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:10,017 INFO [Listener at jenkins-hbase4.apache.org/32789] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:10,111 INFO [Listener at jenkins-hbase4.apache.org/32789] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:10,118 INFO [Listener at jenkins-hbase4.apache.org/32789] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39277 2023-09-14 04:01:10,588 WARN [Listener at jenkins-hbase4.apache.org/43187] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 04:01:10,613 WARN [Listener at jenkins-hbase4.apache.org/43187] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-14 04:01:10,613 INFO [Listener at jenkins-hbase4.apache.org/43187] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 04:01:10,620 INFO [Listener at jenkins-hbase4.apache.org/43187] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43139_node____svmbw6/webapp 2023-09-14 04:01:10,670 INFO [Listener at jenkins-hbase4.apache.org/43187] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-14 04:01:10,671 INFO [Listener at jenkins-hbase4.apache.org/43187] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-14 04:01:10,671 INFO [Listener at jenkins-hbase4.apache.org/43187] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-14 04:01:10,671 INFO [Listener at jenkins-hbase4.apache.org/43187] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-14 04:01:10,679 INFO [Listener at jenkins-hbase4.apache.org/43187] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:10,699 INFO [Listener at jenkins-hbase4.apache.org/43187] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:10,761 INFO [Listener at jenkins-hbase4.apache.org/43187] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:10,770 INFO [Listener at jenkins-hbase4.apache.org/43187] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43139 2023-09-14 04:01:10,948 WARN [Listener at jenkins-hbase4.apache.org/37059] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-14 04:01:10,954 WARN [Listener at jenkins-hbase4.apache.org/37059] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-14 04:01:10,954 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): jetty-6.1.26 2023-09-14 04:01:10,961 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41555_node____isxhkm/webapp 2023-09-14 04:01:11,011 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-14 04:01:11,011 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-14 04:01:11,011 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-14 04:01:11,011 INFO [Listener at jenkins-hbase4.apache.org/37059] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-14 04:01:11,019 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:11,032 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:11,087 INFO [Listener at jenkins-hbase4.apache.org/37059] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-14 04:01:11,092 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41555 2023-09-14 04:01:11,120 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-14 04:01:11,122 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:01:11,178 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=165, AvailableMemoryMB=9763 2023-09-14 04:01:11,178 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-09-14 04:01:11,193 DEBUG [Listener at jenkins-hbase4.apache.org/37059] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-14 04:01:11,198 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-14 04:01:11,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 04:01:11,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-14 04:01:11,209 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 04:01:11,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-14 04:01:11,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 04:01:11,212 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 04:01:11,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:11,219 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31 empty. 2023-09-14 04:01:11,220 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:11,221 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:11,223 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68 empty. 2023-09-14 04:01:11,224 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:11,224 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-14 04:01:11,253 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-14 04:01:11,255 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => d517e2611dc8176fdfef97866b990f31, NAME => 'testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:01:11,255 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4b34e017ed939f1cf0b30f0f15ef3e68, NAME => 'testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:01:11,295 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:11,296 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing d517e2611dc8176fdfef97866b990f31, disabling compactions & flushes 2023-09-14 04:01:11,296 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:11,296 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:11,296 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. after waiting 0 ms 2023-09-14 04:01:11,296 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:11,296 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:11,296 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for d517e2611dc8176fdfef97866b990f31: 2023-09-14 04:01:11,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 04:01:11,332 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 04:01:11,486 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-14 04:01:11,488 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-14 04:01:11,489 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-14 04:01:11,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 04:01:11,696 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:11,696 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 4b34e017ed939f1cf0b30f0f15ef3e68, disabling compactions & flushes 2023-09-14 04:01:11,696 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:11,697 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:11,697 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. after waiting 0 ms 2023-09-14 04:01:11,697 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:11,697 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:11,697 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 4b34e017ed939f1cf0b30f0f15ef3e68: 2023-09-14 04:01:11,701 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 04:01:11,702 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664071702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664071702"}]},"ts":"1694664071702"} 2023-09-14 04:01:11,702 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664071702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664071702"}]},"ts":"1694664071702"} 2023-09-14 04:01:11,751 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 04:01:11,752 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 04:01:11,753 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664071753"}]},"ts":"1694664071753"} 2023-09-14 04:01:11,755 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-14 04:01:11,760 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:01:11,762 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:01:11,762 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:01:11,762 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:01:11,762 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:01:11,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d517e2611dc8176fdfef97866b990f31, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4b34e017ed939f1cf0b30f0f15ef3e68, ASSIGN}] 2023-09-14 04:01:11,765 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4b34e017ed939f1cf0b30f0f15ef3e68, ASSIGN 2023-09-14 04:01:11,765 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d517e2611dc8176fdfef97866b990f31, ASSIGN 2023-09-14 04:01:11,768 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4b34e017ed939f1cf0b30f0f15ef3e68, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39261,1694664063868; forceNewPlan=false, retain=false 2023-09-14 04:01:11,768 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d517e2611dc8176fdfef97866b990f31, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34905,1694664063818; forceNewPlan=false, retain=false 2023-09-14 04:01:11,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 04:01:11,918 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 04:01:11,921 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d517e2611dc8176fdfef97866b990f31, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:11,921 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4b34e017ed939f1cf0b30f0f15ef3e68, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:11,921 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664071921"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664071921"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664071921"}]},"ts":"1694664071921"} 2023-09-14 04:01:11,921 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664071921"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664071921"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664071921"}]},"ts":"1694664071921"} 2023-09-14 04:01:11,924 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure d517e2611dc8176fdfef97866b990f31, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:01:11,926 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 4b34e017ed939f1cf0b30f0f15ef3e68, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:01:12,078 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,078 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 04:01:12,082 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 04:01:12,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:12,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:12,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b34e017ed939f1cf0b30f0f15ef3e68, NAME => 'testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 04:01:12,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d517e2611dc8176fdfef97866b990f31, NAME => 'testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 04:01:12,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. service=AccessControlService 2023-09-14 04:01:12,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. service=AccessControlService 2023-09-14 04:01:12,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:12,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:12,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:12,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:12,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:12,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:12,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:12,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:12,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:12,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:12,103 INFO [StoreOpener-4b34e017ed939f1cf0b30f0f15ef3e68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:12,103 INFO [StoreOpener-d517e2611dc8176fdfef97866b990f31-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:12,106 DEBUG [StoreOpener-4b34e017ed939f1cf0b30f0f15ef3e68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/cf 2023-09-14 04:01:12,106 DEBUG [StoreOpener-4b34e017ed939f1cf0b30f0f15ef3e68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/cf 2023-09-14 04:01:12,106 DEBUG [StoreOpener-d517e2611dc8176fdfef97866b990f31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/cf 2023-09-14 04:01:12,106 DEBUG [StoreOpener-d517e2611dc8176fdfef97866b990f31-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/cf 2023-09-14 04:01:12,110 INFO [StoreOpener-d517e2611dc8176fdfef97866b990f31-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d517e2611dc8176fdfef97866b990f31 columnFamilyName cf 2023-09-14 04:01:12,110 INFO [StoreOpener-4b34e017ed939f1cf0b30f0f15ef3e68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b34e017ed939f1cf0b30f0f15ef3e68 columnFamilyName cf 2023-09-14 04:01:12,114 INFO [StoreOpener-d517e2611dc8176fdfef97866b990f31-1] regionserver.HStore(310): Store=d517e2611dc8176fdfef97866b990f31/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:12,114 INFO [StoreOpener-4b34e017ed939f1cf0b30f0f15ef3e68-1] regionserver.HStore(310): Store=4b34e017ed939f1cf0b30f0f15ef3e68/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:12,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:12,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:12,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:12,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:12,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:12,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:12,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:12,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:12,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d517e2611dc8176fdfef97866b990f31; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70027633, jitterRate=0.04349304735660553}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:01:12,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d517e2611dc8176fdfef97866b990f31: 2023-09-14 04:01:12,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b34e017ed939f1cf0b30f0f15ef3e68; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72156990, jitterRate=0.0752229392528534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:01:12,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b34e017ed939f1cf0b30f0f15ef3e68: 2023-09-14 04:01:12,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31., pid=15, masterSystemTime=1694664072078 2023-09-14 04:01:12,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68., pid=16, masterSystemTime=1694664072079 2023-09-14 04:01:12,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:12,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:12,147 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d517e2611dc8176fdfef97866b990f31, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:12,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:12,148 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664072147"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664072147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664072147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664072147"}]},"ts":"1694664072147"} 2023-09-14 04:01:12,149 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4b34e017ed939f1cf0b30f0f15ef3e68, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,149 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664072148"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664072148"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664072148"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664072148"}]},"ts":"1694664072148"} 2023-09-14 04:01:12,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-14 04:01:12,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure d517e2611dc8176fdfef97866b990f31, server=jenkins-hbase4.apache.org,34905,1694664063818 in 227 msec 2023-09-14 04:01:12,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-14 04:01:12,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 4b34e017ed939f1cf0b30f0f15ef3e68, server=jenkins-hbase4.apache.org,39261,1694664063868 in 227 msec 2023-09-14 04:01:12,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d517e2611dc8176fdfef97866b990f31, ASSIGN in 394 msec 2023-09-14 04:01:12,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-14 04:01:12,164 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4b34e017ed939f1cf0b30f0f15ef3e68, ASSIGN in 398 msec 2023-09-14 04:01:12,165 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 04:01:12,165 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664072165"}]},"ts":"1694664072165"} 2023-09-14 04:01:12,167 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-14 04:01:12,170 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 04:01:12,176 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-14 04:01:12,186 DEBUG [hconnection-0x69a89876-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:12,189 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-09-14 04:01:12,197 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-14 04:01:12,235 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:12,235 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:12,235 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:12,235 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:12,236 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:01:12,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:12,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:12,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:12,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:12,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 1.0410 sec 2023-09-14 04:01:12,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-14 04:01:12,320 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-14 04:01:12,324 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-14 04:01:12,325 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:12,327 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:01:12,350 DEBUG [hconnection-0x162add54-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:12,355 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:12,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 04:01:12,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664072372 (current time:1694664072372). 2023-09-14 04:01:12,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:01:12,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x35a3969b to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:12,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e979a23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:12,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:12,389 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:12,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35a3969b to 127.0.0.1:64527 2023-09-14 04:01:12,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:12,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x210c093c to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:12,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29caf6ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:12,400 DEBUG [hconnection-0x670917d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:12,401 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:12,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:12,406 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:12,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x210c093c to 127.0.0.1:64527 2023-09-14 04:01:12,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:12,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-14 04:01:12,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:01:12,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 04:01:12,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 04:01:12,451 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 04:01:12,452 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694664672452 2023-09-14 04:01:12,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 04:01:12,453 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-14 04:01:12,455 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 04:01:12,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 04:01:12,458 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 12 msec 2023-09-14 04:01:12,458 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 04:01:12,459 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694664672459 2023-09-14 04:01:12,460 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:01:12,460 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:01:12,483 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,483 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-14 04:01:12,483 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:12,484 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-14 04:01:12,484 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-14 04:01:12,485 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,485 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,491 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:12,491 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:12,491 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,491 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:12,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:12,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:12,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:12,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:12,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:12,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:12,492 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,492 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,492 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,492 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,493 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:01:12,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-14 04:01:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-14 04:01:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-14 04:01:12,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 04:01:12,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 04:01:12,494 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 04:01:12,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,498 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 04:01:12,498 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 04:01:12,498 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:12,498 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:12,499 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 04:01:12,499 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 04:01:12,499 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:12,499 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-14 04:01:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 04:01:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-14 04:01:12,499 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 04:01:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-14 04:01:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-14 04:01:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-14 04:01:12,500 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-14 04:01:12,504 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,504 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:12,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:12,504 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,504 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,504 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,504 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:12,504 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:12,505 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,505 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:12,505 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:12,505 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:12,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:12,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-14 04:01:12,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75858fdd[Count = 1] remaining members to acquire global barrier 2023-09-14 04:01:12,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:12,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:12,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:12,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:12,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:12,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-14 04:01:12,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75858fdd[Count = 0] remaining members to acquire global barrier 2023-09-14 04:01:12,510 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-14 04:01:12,511 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 04:01:12,513 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 04:01:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,513 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,513 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 04:01:12,513 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-14 04:01:12,513 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:01:12,514 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,514 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:01:12,514 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:12,514 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:12,514 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:12,514 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:12,514 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:12,514 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:12,515 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. started... 2023-09-14 04:01:12,515 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. started... 2023-09-14 04:01:12,517 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 04:01:12,517 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:12,517 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-14 04:01:12,519 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b34e017ed939f1cf0b30f0f15ef3e68: 2023-09-14 04:01:12,519 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d517e2611dc8176fdfef97866b990f31: 2023-09-14 04:01:12,520 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,520 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,525 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:12,525 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:12,528 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:01:12,528 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:01:12,554 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. completed. 2023-09-14 04:01:12,554 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. completed. 2023-09-14 04:01:12,554 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:12,554 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-14 04:01:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-14 04:01:12,555 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:01:12,556 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:01:12,558 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,558 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 04:01:12,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,558 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:12,558 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 04:01:12,558 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,559 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:12,558 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-14 04:01:12,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:12,560 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:12,560 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-14 04:01:12,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:12,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:12,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:12,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 04:01:12,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:12,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:01:12,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,566 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:01:12,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:01:12,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-14 04:01:12,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:12,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:12,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:12,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:12,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:12,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:01:12,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-14 04:01:12,572 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-14 04:01:12,572 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:01:12,572 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:01:12,572 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,572 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:01:12,575 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,575 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,575 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:12,575 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:12,575 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,575 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:12,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,576 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:12,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:12,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:12,576 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:12,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:12,577 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:12,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,578 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:12,580 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,581 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,581 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,594 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,594 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,594 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:12,595 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:12,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:12,595 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:12,595 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:12,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:12,595 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:12,595 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:12,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,595 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:12,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:12,595 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:12,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:12,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:12,596 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-14 04:01:12,596 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,596 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,596 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,596 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,596 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:12,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:01:12,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:12,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:12,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:12,597 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:12,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:12,597 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,597 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 04:01:12,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-14 04:01:12,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:12,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694664072453Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694664072615 (+162 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694664072615Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694664072615Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694664072629 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694664072659 (+30 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694664072671 (+12 ms) 2023-09-14 04:01:12,675 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 04:01:12,677 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 221 msec 2023-09-14 04:01:12,710 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:01:12,712 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-14 04:01:12,712 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:01:12,712 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-14 04:01:12,712 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-14 04:01:12,713 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-14 04:01:12,713 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:01:12,713 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-14 04:01:12,713 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-14 04:01:12,713 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-14 04:01:12,766 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:12,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 04:01:12,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:01:12,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34905] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:01:12,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39261] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:01:12,790 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-14 04:01:12,790 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:12,790 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:01:12,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 04:01:12,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664072805 (current time:1694664072805). 2023-09-14 04:01:12,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:01:12,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x20ee2e63 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:12,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25388417, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:12,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:12,817 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54038, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:12,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20ee2e63 to 127.0.0.1:64527 2023-09-14 04:01:12,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:12,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x0ee680f1 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:12,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5faa3a78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:12,827 DEBUG [hconnection-0x3ed315a6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:12,829 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:12,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:12,837 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:12,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ee680f1 to 127.0.0.1:64527 2023-09-14 04:01:12,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:12,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-14 04:01:12,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:01:12,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 04:01:12,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 04:01:12,844 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 04:01:12,845 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694664672845 2023-09-14 04:01:12,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-14 04:01:12,845 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-14 04:01:12,846 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:01:12,846 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:01:12,847 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-14 04:01:12,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 04:01:12,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 5 msec 2023-09-14 04:01:12,850 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 04:01:12,850 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694664672850 2023-09-14 04:01:12,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-14 04:01:12,868 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-14 04:01:12,868 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:12,869 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-14 04:01:12,869 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-14 04:01:12,869 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,870 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,871 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:12,871 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:12,871 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:12,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:12,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:12,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:12,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:12,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:12,871 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:12,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,872 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,872 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,873 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 04:01:12,873 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-14 04:01:12,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-14 04:01:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 04:01:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:12,877 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 04:01:12,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-14 04:01:12,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-14 04:01:12,877 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-14 04:01:12,877 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 04:01:12,877 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-14 04:01:12,877 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:12,877 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-14 04:01:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 04:01:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-14 04:01:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-14 04:01:12,879 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-14 04:01:12,879 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-14 04:01:12,879 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-14 04:01:12,882 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:12,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:12,883 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:12,883 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 04:01:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:12,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-14 04:01:12,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29a5febc[Count = 1] remaining members to acquire global barrier 2023-09-14 04:01:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 04:01:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:12,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-14 04:01:12,888 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29a5febc[Count = 0] remaining members to acquire global barrier 2023-09-14 04:01:12,888 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-14 04:01:12,888 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,891 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,892 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,892 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,892 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 04:01:12,892 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:12,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:12,892 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:12,892 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:12,892 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 04:01:12,892 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-14 04:01:12,892 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:12,892 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:01:12,892 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-14 04:01:12,892 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:12,893 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:12,892 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:12,893 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. started... 2023-09-14 04:01:12,893 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. started... 2023-09-14 04:01:12,893 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:12,892 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:01:12,893 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d517e2611dc8176fdfef97866b990f31 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-14 04:01:12,893 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4b34e017ed939f1cf0b30f0f15ef3e68 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-14 04:01:12,897 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 04:01:12,897 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:12,897 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-14 04:01:12,946 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:12,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 04:01:12,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:01:12,948 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:01:13,032 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230914e9c75f31a29e43ce878b9f7521ac5102 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914e9c75f31a29e43ce878b9f7521ac5102 2023-09-14 04:01:13,032 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230914e48a888445d043d183492c4fc9e7a6f6 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230914e48a888445d043d183492c4fc9e7a6f6 2023-09-14 04:01:13,060 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/.tmp/cf/8815f3c7f8b347688d583ada81bc2abf 2023-09-14 04:01:13,062 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/.tmp/cf/a13c7b72cd3149ec801803b230a99e17 2023-09-14 04:01:13,073 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/.tmp/cf/a13c7b72cd3149ec801803b230a99e17 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/cf/a13c7b72cd3149ec801803b230a99e17 2023-09-14 04:01:13,073 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/.tmp/cf/8815f3c7f8b347688d583ada81bc2abf as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/cf/8815f3c7f8b347688d583ada81bc2abf 2023-09-14 04:01:13,082 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/cf/8815f3c7f8b347688d583ada81bc2abf, entries=4, sequenceid=6, filesize=5.6 K 2023-09-14 04:01:13,084 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/cf/a13c7b72cd3149ec801803b230a99e17, entries=46, sequenceid=6, filesize=12.6 K 2023-09-14 04:01:13,087 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for d517e2611dc8176fdfef97866b990f31 in 194ms, sequenceid=6, compaction requested=false 2023-09-14 04:01:13,087 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-14 04:01:13,088 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 4b34e017ed939f1cf0b30f0f15ef3e68 in 195ms, sequenceid=6, compaction requested=false 2023-09-14 04:01:13,088 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-14 04:01:13,089 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d517e2611dc8176fdfef97866b990f31: 2023-09-14 04:01:13,089 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b34e017ed939f1cf0b30f0f15ef3e68: 2023-09-14 04:01:13,090 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-14 04:01:13,090 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:13,090 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-14 04:01:13,090 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/cf/8815f3c7f8b347688d583ada81bc2abf] hfiles 2023-09-14 04:01:13,090 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:13,090 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/cf/8815f3c7f8b347688d583ada81bc2abf for snapshot=snaptb0-testExportWithTargetName 2023-09-14 04:01:13,090 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/cf/a13c7b72cd3149ec801803b230a99e17] hfiles 2023-09-14 04:01:13,091 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/cf/a13c7b72cd3149ec801803b230a99e17 for snapshot=snaptb0-testExportWithTargetName 2023-09-14 04:01:13,119 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. completed. 2023-09-14 04:01:13,120 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:13,120 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. completed. 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,120 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-14 04:01:13,120 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:01:13,123 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 04:01:13,123 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,123 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:13,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,123 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-14 04:01:13,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:13,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:13,124 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,124 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-14 04:01:13,124 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:13,124 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-14 04:01:13,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:13,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:13,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 04:01:13,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:13,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 04:01:13,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:01:13,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-14 04:01:13,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:13,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:13,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:13,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:13,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 04:01:13,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 04:01:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:01:13,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-14 04:01:13,135 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-14 04:01:13,136 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:01:13,136 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:01:13,136 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-14 04:01:13,136 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:01:13,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:13,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:13,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:13,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:13,139 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:13,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:13,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 04:01:13,139 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:13,140 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 04:01:13,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:13,142 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-14 04:01:13,143 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,143 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,149 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:13,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 04:01:13,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:01:13,156 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-14 04:01:13,158 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,158 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:13,158 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:13,158 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:13,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:13,158 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:13,158 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,158 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:13,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:13,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:13,158 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:13,159 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:13,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-14 04:01:13,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:13,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-14 04:01:13,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:13,158 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-14 04:01:13,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:01:13,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:13,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:13,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:13,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:13,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:13,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:13,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:13,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:13,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914e9c75f31a29e43ce878b9f7521ac5102, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230914e48a888445d043d183492c4fc9e7a6f6] mob files 2023-09-14 04:01:13,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914e9c75f31a29e43ce878b9f7521ac5102 2023-09-14 04:01:13,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230914e48a888445d043d183492c4fc9e7a6f6 2023-09-14 04:01:13,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-14 04:01:13,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,231 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-14 04:01:13,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,232 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-14 04:01:13,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694664072845Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694664073190 (+345 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694664073190Loading Region manifests for snaptb0-testExportWithTargetName at 1694664073190Writing data manifest for snaptb0-testExportWithTargetName at 1694664073196 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694664073219 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694664073231 (+12 ms) 2023-09-14 04:01:13,235 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-14 04:01:13,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 389 msec 2023-09-14 04:01:13,456 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:13,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-14 04:01:13,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:01:13,460 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460 2023-09-14 04:01:13,461 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43181, tgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460, rawTgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460, srcFsUri=hdfs://localhost:43181, srcDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:13,512 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:13,512 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-834965281_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-14 04:01:13,512 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33, snapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-14 04:01:13,533 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-14 04:01:13,600 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:13,600 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:13,601 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:13,601 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:14,535 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-5394198406912819233.jar 2023-09-14 04:01:14,536 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:14,536 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:14,603 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-1288291425085014084.jar 2023-09-14 04:01:14,604 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:14,605 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:14,605 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:14,606 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:14,606 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:14,606 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:14,607 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 04:01:14,608 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 04:01:14,609 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 04:01:14,609 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 04:01:14,610 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 04:01:14,611 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 04:01:14,611 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 04:01:14,612 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 04:01:14,612 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 04:01:14,613 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 04:01:14,617 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:14,617 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:14,617 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:14,618 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:14,618 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:14,619 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:14,619 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:15,425 WARN [Listener at jenkins-hbase4.apache.org/37059] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 04:01:15,432 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-14 04:01:15,443 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-14 04:01:15,887 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:01:15,889 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:01:16,095 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0001_000001 (auth:SIMPLE) 2023-09-14 04:01:17,599 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 04:01:20,427 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0001_000001 (auth:SIMPLE) 2023-09-14 04:01:22,668 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0001_000001 (auth:SIMPLE) 2023-09-14 04:01:25,460 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0001_000001 (auth:SIMPLE) 2023-09-14 04:01:27,264 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 04:01:27,267 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 04:01:27,277 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-14 04:01:27,277 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 04:01:27,278 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 04:01:27,278 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-14 04:01:27,279 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-14 04:01:27,279 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-14 04:01:27,279 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460/.hbase-snapshot/testExportWithTargetName 2023-09-14 04:01:27,280 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-14 04:01:27,280 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664073460/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-14 04:01:27,291 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-14 04:01:27,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-14 04:01:27,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-14 04:01:27,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664087309"}]},"ts":"1694664087309"} 2023-09-14 04:01:27,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-14 04:01:27,311 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-14 04:01:27,362 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-14 04:01:27,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d517e2611dc8176fdfef97866b990f31, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4b34e017ed939f1cf0b30f0f15ef3e68, UNASSIGN}] 2023-09-14 04:01:27,367 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d517e2611dc8176fdfef97866b990f31, UNASSIGN 2023-09-14 04:01:27,367 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4b34e017ed939f1cf0b30f0f15ef3e68, UNASSIGN 2023-09-14 04:01:27,368 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=d517e2611dc8176fdfef97866b990f31, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:27,368 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4b34e017ed939f1cf0b30f0f15ef3e68, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:27,368 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664087368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664087368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664087368"}]},"ts":"1694664087368"} 2023-09-14 04:01:27,368 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664087368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664087368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664087368"}]},"ts":"1694664087368"} 2023-09-14 04:01:27,370 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure d517e2611dc8176fdfef97866b990f31, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:01:27,371 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 4b34e017ed939f1cf0b30f0f15ef3e68, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:01:27,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-14 04:01:27,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:27,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:27,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d517e2611dc8176fdfef97866b990f31, disabling compactions & flushes 2023-09-14 04:01:27,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b34e017ed939f1cf0b30f0f15ef3e68, disabling compactions & flushes 2023-09-14 04:01:27,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:27,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:27,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:27,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:27,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. after waiting 0 ms 2023-09-14 04:01:27,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. after waiting 0 ms 2023-09-14 04:01:27,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:27,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:27,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:01:27,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:01:27,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:01:27,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:01:27,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68. 2023-09-14 04:01:27,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31. 2023-09-14 04:01:27,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b34e017ed939f1cf0b30f0f15ef3e68: 2023-09-14 04:01:27,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d517e2611dc8176fdfef97866b990f31: 2023-09-14 04:01:27,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:27,551 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=d517e2611dc8176fdfef97866b990f31, regionState=CLOSED 2023-09-14 04:01:27,551 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664087551"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664087551"}]},"ts":"1694664087551"} 2023-09-14 04:01:27,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:27,554 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4b34e017ed939f1cf0b30f0f15ef3e68, regionState=CLOSED 2023-09-14 04:01:27,554 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694664087554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664087554"}]},"ts":"1694664087554"} 2023-09-14 04:01:27,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-14 04:01:27,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure d517e2611dc8176fdfef97866b990f31, server=jenkins-hbase4.apache.org,34905,1694664063818 in 183 msec 2023-09-14 04:01:27,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=d517e2611dc8176fdfef97866b990f31, UNASSIGN in 192 msec 2023-09-14 04:01:27,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-14 04:01:27,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 4b34e017ed939f1cf0b30f0f15ef3e68, server=jenkins-hbase4.apache.org,39261,1694664063868 in 185 msec 2023-09-14 04:01:27,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-14 04:01:27,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4b34e017ed939f1cf0b30f0f15ef3e68, UNASSIGN in 194 msec 2023-09-14 04:01:27,563 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664087562"}]},"ts":"1694664087562"} 2023-09-14 04:01:27,564 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-14 04:01:27,567 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-14 04:01:27,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 268 msec 2023-09-14 04:01:27,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-14 04:01:27,613 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-14 04:01:27,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-14 04:01:27,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 04:01:27,628 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 04:01:27,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-14 04:01:27,630 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 04:01:27,633 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-14 04:01:27,636 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 04:01:27,636 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 04:01:27,636 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 04:01:27,636 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-14 04:01:27,637 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:27,638 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:27,638 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:27,638 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:27,638 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-14 04:01:27,638 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-14 04:01:27,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-14 04:01:27,639 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-14 04:01:27,639 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:27,638 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:27,639 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-14 04:01:27,638 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-14 04:01:27,639 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-14 04:01:27,639 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-14 04:01:27,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-14 04:01:27,642 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/recovered.edits] 2023-09-14 04:01:27,642 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/recovered.edits] 2023-09-14 04:01:27,650 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/cf/a13c7b72cd3149ec801803b230a99e17 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/cf/a13c7b72cd3149ec801803b230a99e17 2023-09-14 04:01:27,650 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/cf/8815f3c7f8b347688d583ada81bc2abf to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/cf/8815f3c7f8b347688d583ada81bc2abf 2023-09-14 04:01:27,655 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68/recovered.edits/9.seqid 2023-09-14 04:01:27,655 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31/recovered.edits/9.seqid 2023-09-14 04:01:27,655 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/4b34e017ed939f1cf0b30f0f15ef3e68 2023-09-14 04:01:27,655 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportWithTargetName/d517e2611dc8176fdfef97866b990f31 2023-09-14 04:01:27,656 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-14 04:01:27,656 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-14 04:01:27,657 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-14 04:01:27,662 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914e9c75f31a29e43ce878b9f7521ac5102 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230914e9c75f31a29e43ce878b9f7521ac5102 2023-09-14 04:01:27,664 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230914e48a888445d043d183492c4fc9e7a6f6 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230914e48a888445d043d183492c4fc9e7a6f6 2023-09-14 04:01:27,665 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-14 04:01:27,668 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 04:01:27,689 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-14 04:01:27,692 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-14 04:01:27,694 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 04:01:27,694 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-14 04:01:27,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664087694"}]},"ts":"9223372036854775807"} 2023-09-14 04:01:27,694 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664087694"}]},"ts":"9223372036854775807"} 2023-09-14 04:01:27,697 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 04:01:27,697 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d517e2611dc8176fdfef97866b990f31, NAME => 'testtb-testExportWithTargetName,,1694664071204.d517e2611dc8176fdfef97866b990f31.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4b34e017ed939f1cf0b30f0f15ef3e68, NAME => 'testtb-testExportWithTargetName,1,1694664071204.4b34e017ed939f1cf0b30f0f15ef3e68.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 04:01:27,697 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-14 04:01:27,697 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694664087697"}]},"ts":"9223372036854775807"} 2023-09-14 04:01:27,699 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-14 04:01:27,702 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-14 04:01:27,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 83 msec 2023-09-14 04:01:27,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-14 04:01:27,745 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-14 04:01:27,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-14 04:01:27,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-14 04:01:27,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-14 04:01:27,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-14 04:01:27,806 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 707) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1743040450_1 at /127.0.0.1:58106 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:55716 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:58124 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:34747 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:43187 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:33003 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 112) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=9012 (was 9763) 2023-09-14 04:01:27,807 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-14 04:01:27,827 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=161, ProcessCount=168, AvailableMemoryMB=9012 2023-09-14 04:01:27,827 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-14 04:01:27,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 04:01:27,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-14 04:01:27,834 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 04:01:27,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-14 04:01:27,836 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 04:01:27,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-14 04:01:27,839 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:27,839 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:27,840 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753 empty. 2023-09-14 04:01:27,840 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad empty. 2023-09-14 04:01:27,840 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:27,840 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:27,840 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-14 04:01:27,852 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-14 04:01:27,854 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9b50d799657d2580e12000faccfeb753, NAME => 'testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:01:27,854 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 34a01005bfde8e1e508956406c2f24ad, NAME => 'testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:01:27,864 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:27,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9b50d799657d2580e12000faccfeb753, disabling compactions & flushes 2023-09-14 04:01:27,865 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:27,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:27,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. after waiting 0 ms 2023-09-14 04:01:27,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:27,865 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:27,865 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9b50d799657d2580e12000faccfeb753: 2023-09-14 04:01:27,866 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:27,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 34a01005bfde8e1e508956406c2f24ad, disabling compactions & flushes 2023-09-14 04:01:27,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:27,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:27,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. after waiting 0 ms 2023-09-14 04:01:27,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:27,867 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:27,867 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 34a01005bfde8e1e508956406c2f24ad: 2023-09-14 04:01:27,870 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 04:01:27,871 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664087871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664087871"}]},"ts":"1694664087871"} 2023-09-14 04:01:27,871 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664087871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664087871"}]},"ts":"1694664087871"} 2023-09-14 04:01:27,874 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 04:01:27,875 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 04:01:27,875 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664087875"}]},"ts":"1694664087875"} 2023-09-14 04:01:27,877 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-14 04:01:27,880 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:01:27,881 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:01:27,881 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:01:27,881 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:01:27,881 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:01:27,881 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9b50d799657d2580e12000faccfeb753, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34a01005bfde8e1e508956406c2f24ad, ASSIGN}] 2023-09-14 04:01:27,883 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9b50d799657d2580e12000faccfeb753, ASSIGN 2023-09-14 04:01:27,884 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34a01005bfde8e1e508956406c2f24ad, ASSIGN 2023-09-14 04:01:27,885 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9b50d799657d2580e12000faccfeb753, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34905,1694664063818; forceNewPlan=false, retain=false 2023-09-14 04:01:27,885 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34a01005bfde8e1e508956406c2f24ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39261,1694664063868; forceNewPlan=false, retain=false 2023-09-14 04:01:27,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-14 04:01:28,035 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 04:01:28,038 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9b50d799657d2580e12000faccfeb753, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,038 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=34a01005bfde8e1e508956406c2f24ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,038 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664088037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664088037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664088037"}]},"ts":"1694664088037"} 2023-09-14 04:01:28,038 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664088037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664088037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664088037"}]},"ts":"1694664088037"} 2023-09-14 04:01:28,040 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 9b50d799657d2580e12000faccfeb753, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:01:28,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 34a01005bfde8e1e508956406c2f24ad, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:01:28,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-14 04:01:28,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:28,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 34a01005bfde8e1e508956406c2f24ad, NAME => 'testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 04:01:28,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. service=AccessControlService 2023-09-14 04:01:28,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:28,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:28,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:28,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:28,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:28,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:28,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b50d799657d2580e12000faccfeb753, NAME => 'testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 04:01:28,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. service=AccessControlService 2023-09-14 04:01:28,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:28,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:28,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:28,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:28,200 INFO [StoreOpener-34a01005bfde8e1e508956406c2f24ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:28,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:28,202 DEBUG [StoreOpener-34a01005bfde8e1e508956406c2f24ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/cf 2023-09-14 04:01:28,202 DEBUG [StoreOpener-34a01005bfde8e1e508956406c2f24ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/cf 2023-09-14 04:01:28,202 INFO [StoreOpener-9b50d799657d2580e12000faccfeb753-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:28,202 INFO [StoreOpener-34a01005bfde8e1e508956406c2f24ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 34a01005bfde8e1e508956406c2f24ad columnFamilyName cf 2023-09-14 04:01:28,204 DEBUG [StoreOpener-9b50d799657d2580e12000faccfeb753-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/cf 2023-09-14 04:01:28,204 DEBUG [StoreOpener-9b50d799657d2580e12000faccfeb753-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/cf 2023-09-14 04:01:28,204 INFO [StoreOpener-9b50d799657d2580e12000faccfeb753-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b50d799657d2580e12000faccfeb753 columnFamilyName cf 2023-09-14 04:01:28,204 INFO [StoreOpener-34a01005bfde8e1e508956406c2f24ad-1] regionserver.HStore(310): Store=34a01005bfde8e1e508956406c2f24ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:28,206 INFO [StoreOpener-9b50d799657d2580e12000faccfeb753-1] regionserver.HStore(310): Store=9b50d799657d2580e12000faccfeb753/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:28,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:28,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:28,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:28,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:28,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:28,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:28,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:28,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:28,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9b50d799657d2580e12000faccfeb753; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63633208, jitterRate=-0.05179131031036377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:01:28,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 34a01005bfde8e1e508956406c2f24ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65953550, jitterRate=-0.01721552014350891}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:01:28,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9b50d799657d2580e12000faccfeb753: 2023-09-14 04:01:28,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 34a01005bfde8e1e508956406c2f24ad: 2023-09-14 04:01:28,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad., pid=31, masterSystemTime=1694664088194 2023-09-14 04:01:28,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753., pid=30, masterSystemTime=1694664088194 2023-09-14 04:01:28,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:28,219 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:28,220 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9b50d799657d2580e12000faccfeb753, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:28,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:28,220 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664088219"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664088219"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664088219"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664088219"}]},"ts":"1694664088219"} 2023-09-14 04:01:28,221 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=34a01005bfde8e1e508956406c2f24ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,221 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664088220"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664088220"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664088220"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664088220"}]},"ts":"1694664088220"} 2023-09-14 04:01:28,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-14 04:01:28,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 9b50d799657d2580e12000faccfeb753, server=jenkins-hbase4.apache.org,34905,1694664063818 in 182 msec 2023-09-14 04:01:28,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-14 04:01:28,229 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 34a01005bfde8e1e508956406c2f24ad, server=jenkins-hbase4.apache.org,39261,1694664063868 in 182 msec 2023-09-14 04:01:28,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9b50d799657d2580e12000faccfeb753, ASSIGN in 346 msec 2023-09-14 04:01:28,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-14 04:01:28,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34a01005bfde8e1e508956406c2f24ad, ASSIGN in 348 msec 2023-09-14 04:01:28,235 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 04:01:28,235 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664088235"}]},"ts":"1694664088235"} 2023-09-14 04:01:28,236 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-14 04:01:28,239 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 04:01:28,239 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-14 04:01:28,241 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 04:01:28,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:28,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:28,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:28,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:28,246 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:28,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:28,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:28,247 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:28,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 415 msec 2023-09-14 04:01:28,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-14 04:01:28,440 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-14 04:01:28,443 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-14 04:01:28,443 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:28,445 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:01:28,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:01:28,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664088460 (current time:1694664088460). 2023-09-14 04:01:28,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:01:28,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x468bf21c to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:28,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24f49959, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:28,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:28,471 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:28,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x468bf21c to 127.0.0.1:64527 2023-09-14 04:01:28,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:28,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x55cfbef5 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:28,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ccdad42, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:28,514 DEBUG [hconnection-0x4cf3dbd3-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:28,518 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:28,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:28,524 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:28,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55cfbef5 to 127.0.0.1:64527 2023-09-14 04:01:28,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:28,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 04:01:28,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:01:28,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:01:28,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:01:28,530 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:01:28,531 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694664688531 2023-09-14 04:01:28,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:01:28,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-14 04:01:28,532 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:01:28,532 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:01:28,533 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:01:28,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 04:01:28,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-14 04:01:28,536 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 04:01:28,536 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694664688536 2023-09-14 04:01:28,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,557 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-14 04:01:28,557 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:28,558 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-14 04:01:28,558 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-14 04:01:28,559 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,559 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,560 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:28,560 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:28,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:28,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:28,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:28,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:28,560 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:28,560 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:28,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:28,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,561 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,561 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,561 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,561 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-14 04:01:28,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,561 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 04:01:28,562 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 04:01:28,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,562 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 04:01:28,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,562 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:28,562 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 04:01:28,563 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 04:01:28,563 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-14 04:01:28,563 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:28,563 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-14 04:01:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 04:01:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-14 04:01:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-14 04:01:28,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 04:01:28,564 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:28,565 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 04:01:28,565 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-14 04:01:28,565 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-14 04:01:28,571 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,571 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,571 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:28,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:28,571 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,571 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:28,572 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,572 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:28,572 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,572 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:28,572 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,573 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:28,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:28,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:28,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-14 04:01:28,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7030f5a8[Count = 1] remaining members to acquire global barrier 2023-09-14 04:01:28,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:28,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:28,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:28,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:28,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:28,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-14 04:01:28,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7030f5a8[Count = 0] remaining members to acquire global barrier 2023-09-14 04:01:28,578 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-14 04:01:28,578 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,579 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,579 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,579 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,580 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:01:28,580 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:01:28,580 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,580 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-14 04:01:28,580 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:01:28,580 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:01:28,580 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:28,580 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,580 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:01:28,580 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:28,580 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:28,580 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. started... 2023-09-14 04:01:28,583 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 04:01:28,583 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:28,583 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-14 04:01:28,586 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:28,586 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34a01005bfde8e1e508956406c2f24ad: 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. started... 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b50d799657d2580e12000faccfeb753: 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:28,586 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:01:28,618 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. completed. 2023-09-14 04:01:28,618 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:28,618 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-14 04:01:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:01:28,619 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. completed. 2023-09-14 04:01:28,619 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-14 04:01:28,619 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:01:28,621 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 04:01:28,621 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,621 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:28,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,621 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-14 04:01:28,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:28,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:28,622 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 04:01:28,622 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:28,622 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,622 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-14 04:01:28,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:28,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:28,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:28,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:01:28,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-14 04:01:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:28,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:01:28,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-14 04:01:28,630 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-14 04:01:28,630 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:01:28,630 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:01:28,630 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,630 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:01:28,632 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,632 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,632 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,632 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:28,632 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:28,632 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:28,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:28,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:28,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:28,632 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,633 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:28,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,633 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:28,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 04:01:28,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:01:28,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:28,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:28,634 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:28,634 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:01:28,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:28,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,635 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,637 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:28,638 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,638 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,641 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,641 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:28,641 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:28,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:28,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:28,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:28,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:28,642 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:28,641 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,641 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:28,643 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:28,642 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-14 04:01:28,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:01:28,642 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:28,642 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:28,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:28,643 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:28,643 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:28,644 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:28,644 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:28,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 04:01:28,644 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:28,644 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:28,644 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,644 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,644 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-14 04:01:28,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,684 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:28,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694664088531Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694664088655 (+124 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694664088655Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694664088656 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694664088660 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694664088674 (+14 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694664088683 (+9 ms) 2023-09-14 04:01:28,686 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 04:01:28,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 155 msec 2023-09-14 04:01:28,834 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:28,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 04:01:28,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:01:28,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34905] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:01:28,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39261] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:01:28,848 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-14 04:01:28,849 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:28,849 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:01:28,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:01:28,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664088860 (current time:1694664088860). 2023-09-14 04:01:28,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:01:28,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x1ec42571 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:28,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cbb5839, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:28,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:28,871 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:28,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ec42571 to 127.0.0.1:64527 2023-09-14 04:01:28,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:28,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x5ab202ca to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:28,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69d7e227, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:28,880 DEBUG [hconnection-0x1e27f4bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:28,880 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:28,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:28,885 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35308, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:28,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ab202ca to 127.0.0.1:64527 2023-09-14 04:01:28,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:28,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 04:01:28,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:01:28,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:01:28,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:01:28,891 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:01:28,892 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694664688892 2023-09-14 04:01:28,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-14 04:01:28,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:01:28,894 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:01:28,894 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:01:28,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 04:01:28,895 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:01:28,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-14 04:01:28,897 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 04:01:28,898 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694664688898 2023-09-14 04:01:28,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-14 04:01:28,915 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-14 04:01:28,915 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:28,917 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-14 04:01:28,917 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-14 04:01:28,917 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,917 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,919 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:28,919 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:28,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:28,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:28,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:28,919 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,919 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:28,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:28,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:28,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:28,920 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,920 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,920 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,920 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:01:28,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-14 04:01:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-14 04:01:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 04:01:28,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 04:01:28,921 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-14 04:01:28,921 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 04:01:28,921 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:28,921 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-14 04:01:28,923 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 04:01:28,923 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-14 04:01:28,923 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-14 04:01:28,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-14 04:01:28,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,923 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 04:01:28,923 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:28,923 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-14 04:01:28,924 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 04:01:28,924 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-14 04:01:28,924 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-14 04:01:28,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-14 04:01:28,924 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-14 04:01:28,924 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:28,925 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-14 04:01:28,925 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-14 04:01:28,925 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-14 04:01:28,926 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,927 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,927 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,927 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,927 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:28,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:28,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:28,929 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,929 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:28,929 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,929 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:28,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:28,929 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,929 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:28,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 04:01:28,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:28,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-14 04:01:28,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2187e2ec[Count = 1] remaining members to acquire global barrier 2023-09-14 04:01:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 04:01:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:28,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-14 04:01:28,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2187e2ec[Count = 0] remaining members to acquire global barrier 2023-09-14 04:01:28,933 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-14 04:01:28,933 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:01:28,935 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:28,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:28,935 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:28,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. started... 2023-09-14 04:01:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:01:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-14 04:01:28,935 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:28,936 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:01:28,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:28,935 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:01:28,936 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:01:28,936 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 34a01005bfde8e1e508956406c2f24ad 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-14 04:01:28,936 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:28,936 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:28,936 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:28,936 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. started... 2023-09-14 04:01:28,936 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b50d799657d2580e12000faccfeb753 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-14 04:01:28,937 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 04:01:28,937 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:28,938 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-14 04:01:28,966 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309143c473022acfe4449a434dcc60440f61d to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309143c473022acfe4449a434dcc60440f61d 2023-09-14 04:01:28,984 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230914fcbb95accdb7450184c67db4ded58e66 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230914fcbb95accdb7450184c67db4ded58e66 2023-09-14 04:01:28,988 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/.tmp/cf/ad00b186931842e3a540670e4e1ecfc5 2023-09-14 04:01:28,994 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:28,995 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/.tmp/cf/ad00b186931842e3a540670e4e1ecfc5 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/cf/ad00b186931842e3a540670e4e1ecfc5 2023-09-14 04:01:28,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 04:01:28,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:01:28,996 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:01:29,001 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/cf/ad00b186931842e3a540670e4e1ecfc5, entries=3, sequenceid=6, filesize=5.4 K 2023-09-14 04:01:29,002 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 9b50d799657d2580e12000faccfeb753 in 66ms, sequenceid=6, compaction requested=false 2023-09-14 04:01:29,002 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-14 04:01:29,003 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b50d799657d2580e12000faccfeb753: 2023-09-14 04:01:29,003 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-14 04:01:29,003 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:29,004 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/cf/ad00b186931842e3a540670e4e1ecfc5] hfiles 2023-09-14 04:01:29,004 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/cf/ad00b186931842e3a540670e4e1ecfc5 for snapshot=snaptb0-testExportFileSystemState 2023-09-14 04:01:29,006 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/.tmp/cf/fee8fd7e6a7a44a9a0fe60f53eea46fe 2023-09-14 04:01:29,013 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/.tmp/cf/fee8fd7e6a7a44a9a0fe60f53eea46fe as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/cf/fee8fd7e6a7a44a9a0fe60f53eea46fe 2023-09-14 04:01:29,019 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/cf/fee8fd7e6a7a44a9a0fe60f53eea46fe, entries=47, sequenceid=6, filesize=12.8 K 2023-09-14 04:01:29,021 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 34a01005bfde8e1e508956406c2f24ad in 84ms, sequenceid=6, compaction requested=false 2023-09-14 04:01:29,026 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 34a01005bfde8e1e508956406c2f24ad: 2023-09-14 04:01:29,027 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-14 04:01:29,027 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:29,027 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/cf/fee8fd7e6a7a44a9a0fe60f53eea46fe] hfiles 2023-09-14 04:01:29,027 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/cf/fee8fd7e6a7a44a9a0fe60f53eea46fe for snapshot=snaptb0-testExportFileSystemState 2023-09-14 04:01:29,030 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. completed. 2023-09-14 04:01:29,030 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-14 04:01:29,031 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:01:29,037 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 04:01:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-14 04:01:29,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:29,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:29,039 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. completed. 2023-09-14 04:01:29,039 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:29,040 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:29,040 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:29,040 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,040 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-14 04:01:29,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 04:01:29,040 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:01:29,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,043 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-14 04:01:29,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,043 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,043 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:29,043 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-14 04:01:29,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 04:01:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:01:29,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-14 04:01:29,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:29,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:29,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:29,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:29,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 04:01:29,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 04:01:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:01:29,050 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-14 04:01:29,050 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-14 04:01:29,050 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:01:29,050 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:01:29,050 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-14 04:01:29,050 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:01:29,052 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,052 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,052 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:29,052 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:29,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,052 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,052 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:29,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:29,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,052 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:29,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:29,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:29,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:29,053 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:29,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:29,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 04:01:29,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:29,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:29,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,054 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:29,054 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 04:01:29,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:29,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-14 04:01:29,056 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,056 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,057 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:29,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:29,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:29,061 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:29,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:29,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:29,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:29,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:29,061 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:29,061 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:29,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:29,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:29,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:29,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:29,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-14 04:01:29,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:29,064 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:29,064 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-14 04:01:29,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:29,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:01:29,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230914fcbb95accdb7450184c67db4ded58e66, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309143c473022acfe4449a434dcc60440f61d] mob files 2023-09-14 04:01:29,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230914fcbb95accdb7450184c67db4ded58e66 2023-09-14 04:01:29,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309143c473022acfe4449a434dcc60440f61d 2023-09-14 04:01:29,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-14 04:01:29,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,102 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-14 04:01:29,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,103 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694664088892Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694664089076 (+184 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694664089076Loading Region manifests for snaptb0-testExportFileSystemState at 1694664089076Writing data manifest for snaptb0-testExportFileSystemState at 1694664089080 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694664089094 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694664089102 (+8 ms) 2023-09-14 04:01:29,106 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-14 04:01:29,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 213 msec 2023-09-14 04:01:29,196 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:29,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 04:01:29,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:01:29,197 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197 2023-09-14 04:01:29,198 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43181, tgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197, rawTgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197, srcFsUri=hdfs://localhost:43181, srcDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:29,222 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:29,222 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2101349787_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,222 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33, snapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-14 04:01:29,236 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-14 04:01:29,277 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:29,277 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:29,278 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:29,278 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:30,179 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-6674099186234766800.jar 2023-09-14 04:01:30,179 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:30,180 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:30,247 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-2887776712742264865.jar 2023-09-14 04:01:30,248 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:30,248 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:30,249 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:30,249 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:30,249 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:30,250 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:30,250 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 04:01:30,251 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 04:01:30,251 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 04:01:30,252 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 04:01:30,252 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 04:01:30,253 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 04:01:30,254 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 04:01:30,254 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 04:01:30,255 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 04:01:30,256 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 04:01:30,256 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:30,257 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:30,258 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:30,258 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:30,259 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:30,260 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:30,261 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:30,745 WARN [Listener at jenkins-hbase4.apache.org/37059] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 04:01:30,747 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-14 04:01:30,750 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-14 04:01:31,677 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:01:31,677 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:01:31,682 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0001_000001 (auth:SIMPLE) 2023-09-14 04:01:32,124 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0002_000001 (auth:SIMPLE) 2023-09-14 04:01:33,137 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 04:01:36,288 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0002_000001 (auth:SIMPLE) 2023-09-14 04:01:38,523 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0002_000001 (auth:SIMPLE) 2023-09-14 04:01:41,846 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0002_000001 (auth:SIMPLE) 2023-09-14 04:01:42,931 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 04:01:42,932 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 04:01:42,941 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-14 04:01:42,941 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 04:01:42,942 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 04:01:42,942 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-14 04:01:42,943 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-14 04:01:42,943 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-14 04:01:42,943 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-14 04:01:42,943 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-14 04:01:42,943 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664089197/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-14 04:01:42,950 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-14 04:01:42,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-14 04:01:42,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-14 04:01:42,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-14 04:01:42,957 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664102956"}]},"ts":"1694664102956"} 2023-09-14 04:01:42,958 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-14 04:01:42,960 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-14 04:01:42,961 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9b50d799657d2580e12000faccfeb753, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34a01005bfde8e1e508956406c2f24ad, UNASSIGN}] 2023-09-14 04:01:42,963 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9b50d799657d2580e12000faccfeb753, UNASSIGN 2023-09-14 04:01:42,963 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34a01005bfde8e1e508956406c2f24ad, UNASSIGN 2023-09-14 04:01:42,964 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9b50d799657d2580e12000faccfeb753, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:42,964 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664102964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664102964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664102964"}]},"ts":"1694664102964"} 2023-09-14 04:01:42,964 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=34a01005bfde8e1e508956406c2f24ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:42,964 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664102964"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664102964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664102964"}]},"ts":"1694664102964"} 2023-09-14 04:01:42,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9b50d799657d2580e12000faccfeb753, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:01:42,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 34a01005bfde8e1e508956406c2f24ad, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:01:43,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-14 04:01:43,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:43,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9b50d799657d2580e12000faccfeb753, disabling compactions & flushes 2023-09-14 04:01:43,118 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:43,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:43,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. after waiting 0 ms 2023-09-14 04:01:43,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:43,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:43,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 34a01005bfde8e1e508956406c2f24ad, disabling compactions & flushes 2023-09-14 04:01:43,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:43,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:43,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. after waiting 0 ms 2023-09-14 04:01:43,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:43,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:01:43,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:01:43,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:01:43,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:01:43,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753. 2023-09-14 04:01:43,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad. 2023-09-14 04:01:43,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9b50d799657d2580e12000faccfeb753: 2023-09-14 04:01:43,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 34a01005bfde8e1e508956406c2f24ad: 2023-09-14 04:01:43,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:43,134 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=34a01005bfde8e1e508956406c2f24ad, regionState=CLOSED 2023-09-14 04:01:43,134 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664103134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664103134"}]},"ts":"1694664103134"} 2023-09-14 04:01:43,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:43,135 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9b50d799657d2580e12000faccfeb753, regionState=CLOSED 2023-09-14 04:01:43,135 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694664103135"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664103135"}]},"ts":"1694664103135"} 2023-09-14 04:01:43,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-14 04:01:43,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 34a01005bfde8e1e508956406c2f24ad, server=jenkins-hbase4.apache.org,39261,1694664063868 in 170 msec 2023-09-14 04:01:43,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-14 04:01:43,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9b50d799657d2580e12000faccfeb753, server=jenkins-hbase4.apache.org,34905,1694664063818 in 172 msec 2023-09-14 04:01:43,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=34a01005bfde8e1e508956406c2f24ad, UNASSIGN in 177 msec 2023-09-14 04:01:43,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-14 04:01:43,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9b50d799657d2580e12000faccfeb753, UNASSIGN in 178 msec 2023-09-14 04:01:43,142 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664103142"}]},"ts":"1694664103142"} 2023-09-14 04:01:43,143 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-14 04:01:43,145 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-14 04:01:43,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-14 04:01:43,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-14 04:01:43,259 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-14 04:01:43,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-14 04:01:43,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 04:01:43,263 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 04:01:43,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-14 04:01:43,265 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 04:01:43,266 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-14 04:01:43,270 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:43,270 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:43,270 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 04:01:43,270 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 04:01:43,270 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 04:01:43,270 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 04:01:43,270 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-14 04:01:43,270 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-14 04:01:43,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-14 04:01:43,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-14 04:01:43,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 04:01:43,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 04:01:43,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:43,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:43,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 04:01:43,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-14 04:01:43,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:43,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:43,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-14 04:01:43,273 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/recovered.edits] 2023-09-14 04:01:43,273 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/recovered.edits] 2023-09-14 04:01:43,278 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/cf/ad00b186931842e3a540670e4e1ecfc5 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/cf/ad00b186931842e3a540670e4e1ecfc5 2023-09-14 04:01:43,278 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/cf/fee8fd7e6a7a44a9a0fe60f53eea46fe to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/cf/fee8fd7e6a7a44a9a0fe60f53eea46fe 2023-09-14 04:01:43,281 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad/recovered.edits/9.seqid 2023-09-14 04:01:43,282 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753/recovered.edits/9.seqid 2023-09-14 04:01:43,282 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/34a01005bfde8e1e508956406c2f24ad 2023-09-14 04:01:43,282 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemState/9b50d799657d2580e12000faccfeb753 2023-09-14 04:01:43,282 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-14 04:01:43,283 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-14 04:01:43,284 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-14 04:01:43,287 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230914fcbb95accdb7450184c67db4ded58e66 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230914fcbb95accdb7450184c67db4ded58e66 2023-09-14 04:01:43,289 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309143c473022acfe4449a434dcc60440f61d to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309143c473022acfe4449a434dcc60440f61d 2023-09-14 04:01:43,289 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-14 04:01:43,292 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 04:01:43,294 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-14 04:01:43,296 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-14 04:01:43,298 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 04:01:43,298 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-14 04:01:43,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664103298"}]},"ts":"9223372036854775807"} 2023-09-14 04:01:43,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664103298"}]},"ts":"9223372036854775807"} 2023-09-14 04:01:43,300 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 04:01:43,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9b50d799657d2580e12000faccfeb753, NAME => 'testtb-testExportFileSystemState,,1694664087829.9b50d799657d2580e12000faccfeb753.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 34a01005bfde8e1e508956406c2f24ad, NAME => 'testtb-testExportFileSystemState,1,1694664087829.34a01005bfde8e1e508956406c2f24ad.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 04:01:43,301 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-14 04:01:43,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694664103301"}]},"ts":"9223372036854775807"} 2023-09-14 04:01:43,303 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-14 04:01:43,305 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-14 04:01:43,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 45 msec 2023-09-14 04:01:43,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-14 04:01:43,375 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-14 04:01:43,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-14 04:01:43,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-14 04:01:43,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-14 04:01:43,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-14 04:01:43,419 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=762 (was 753) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-800404100_1 at /127.0.0.1:57826 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:48780 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:35944 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:37059 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:33033 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:57848 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=933 (was 926) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=236 (was 161) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=8847 (was 9012) 2023-09-14 04:01:43,419 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-14 04:01:43,444 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=762, OpenFileDescriptor=933, MaxFileDescriptor=60000, SystemLoadAverage=236, ProcessCount=168, AvailableMemoryMB=8844 2023-09-14 04:01:43,444 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-14 04:01:43,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 04:01:43,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-14 04:01:43,451 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 04:01:43,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-14 04:01:43,452 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 04:01:43,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-14 04:01:43,455 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:01:43,455 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0 2023-09-14 04:01:43,456 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28 empty. 2023-09-14 04:01:43,456 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0 empty. 2023-09-14 04:01:43,456 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:01:43,456 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0 2023-09-14 04:01:43,456 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-14 04:01:43,468 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-14 04:01:43,471 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5ebd4b9f4e687e38af590d1df067e28, NAME => 'testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:01:43,471 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => abf550a2615219c173635cf0cb0963a0, NAME => 'testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:01:43,485 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:43,485 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing b5ebd4b9f4e687e38af590d1df067e28, disabling compactions & flushes 2023-09-14 04:01:43,485 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:43,486 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:43,486 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. after waiting 0 ms 2023-09-14 04:01:43,486 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:43,486 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:43,486 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for b5ebd4b9f4e687e38af590d1df067e28: 2023-09-14 04:01:43,488 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:43,488 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing abf550a2615219c173635cf0cb0963a0, disabling compactions & flushes 2023-09-14 04:01:43,488 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:43,488 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:43,488 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. after waiting 0 ms 2023-09-14 04:01:43,488 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:43,488 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:43,488 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for abf550a2615219c173635cf0cb0963a0: 2023-09-14 04:01:43,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 04:01:43,492 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664103492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664103492"}]},"ts":"1694664103492"} 2023-09-14 04:01:43,492 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664103492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664103492"}]},"ts":"1694664103492"} 2023-09-14 04:01:43,494 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 04:01:43,495 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 04:01:43,495 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664103495"}]},"ts":"1694664103495"} 2023-09-14 04:01:43,497 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-14 04:01:43,501 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:01:43,502 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:01:43,502 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:01:43,502 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:01:43,502 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:01:43,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5ebd4b9f4e687e38af590d1df067e28, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=abf550a2615219c173635cf0cb0963a0, ASSIGN}] 2023-09-14 04:01:43,507 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5ebd4b9f4e687e38af590d1df067e28, ASSIGN 2023-09-14 04:01:43,507 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=abf550a2615219c173635cf0cb0963a0, ASSIGN 2023-09-14 04:01:43,508 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5ebd4b9f4e687e38af590d1df067e28, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34905,1694664063818; forceNewPlan=false, retain=false 2023-09-14 04:01:43,508 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=abf550a2615219c173635cf0cb0963a0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39261,1694664063868; forceNewPlan=false, retain=false 2023-09-14 04:01:43,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-14 04:01:43,659 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 04:01:43,661 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b5ebd4b9f4e687e38af590d1df067e28, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:43,661 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=abf550a2615219c173635cf0cb0963a0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:43,662 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664103661"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664103661"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664103661"}]},"ts":"1694664103661"} 2023-09-14 04:01:43,662 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664103661"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664103661"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664103661"}]},"ts":"1694664103661"} 2023-09-14 04:01:43,664 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure abf550a2615219c173635cf0cb0963a0, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:01:43,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure b5ebd4b9f4e687e38af590d1df067e28, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:01:43,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-14 04:01:43,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:43,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => abf550a2615219c173635cf0cb0963a0, NAME => 'testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 04:01:43,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:43,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. service=AccessControlService 2023-09-14 04:01:43,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5ebd4b9f4e687e38af590d1df067e28, NAME => 'testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 04:01:43,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:43,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports abf550a2615219c173635cf0cb0963a0 2023-09-14 04:01:43,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. service=AccessControlService 2023-09-14 04:01:43,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:43,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for abf550a2615219c173635cf0cb0963a0 2023-09-14 04:01:43,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:01:43,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for abf550a2615219c173635cf0cb0963a0 2023-09-14 04:01:43,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:01:43,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:01:43,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:01:43,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:01:43,821 INFO [StoreOpener-abf550a2615219c173635cf0cb0963a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region abf550a2615219c173635cf0cb0963a0 2023-09-14 04:01:43,821 INFO [StoreOpener-b5ebd4b9f4e687e38af590d1df067e28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:01:43,823 DEBUG [StoreOpener-abf550a2615219c173635cf0cb0963a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/cf 2023-09-14 04:01:43,823 DEBUG [StoreOpener-abf550a2615219c173635cf0cb0963a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/cf 2023-09-14 04:01:43,823 DEBUG [StoreOpener-b5ebd4b9f4e687e38af590d1df067e28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/cf 2023-09-14 04:01:43,823 DEBUG [StoreOpener-b5ebd4b9f4e687e38af590d1df067e28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/cf 2023-09-14 04:01:43,823 INFO [StoreOpener-abf550a2615219c173635cf0cb0963a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abf550a2615219c173635cf0cb0963a0 columnFamilyName cf 2023-09-14 04:01:43,823 INFO [StoreOpener-b5ebd4b9f4e687e38af590d1df067e28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5ebd4b9f4e687e38af590d1df067e28 columnFamilyName cf 2023-09-14 04:01:43,824 INFO [StoreOpener-b5ebd4b9f4e687e38af590d1df067e28-1] regionserver.HStore(310): Store=b5ebd4b9f4e687e38af590d1df067e28/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:43,824 INFO [StoreOpener-abf550a2615219c173635cf0cb0963a0-1] regionserver.HStore(310): Store=abf550a2615219c173635cf0cb0963a0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:01:43,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:01:43,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0 2023-09-14 04:01:43,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:01:43,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0 2023-09-14 04:01:43,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:01:43,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for abf550a2615219c173635cf0cb0963a0 2023-09-14 04:01:43,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:43,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:01:43,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5ebd4b9f4e687e38af590d1df067e28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69064786, jitterRate=0.029145509004592896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:01:43,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened abf550a2615219c173635cf0cb0963a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68642455, jitterRate=0.02285228669643402}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:01:43,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5ebd4b9f4e687e38af590d1df067e28: 2023-09-14 04:01:43,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for abf550a2615219c173635cf0cb0963a0: 2023-09-14 04:01:43,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28., pid=46, masterSystemTime=1694664103817 2023-09-14 04:01:43,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0., pid=45, masterSystemTime=1694664103815 2023-09-14 04:01:43,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:43,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:43,834 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=b5ebd4b9f4e687e38af590d1df067e28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:43,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:43,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:43,834 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664103834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664103834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664103834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664103834"}]},"ts":"1694664103834"} 2023-09-14 04:01:43,835 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=abf550a2615219c173635cf0cb0963a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:43,835 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664103835"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664103835"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664103835"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664103835"}]},"ts":"1694664103835"} 2023-09-14 04:01:43,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-14 04:01:43,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure b5ebd4b9f4e687e38af590d1df067e28, server=jenkins-hbase4.apache.org,34905,1694664063818 in 172 msec 2023-09-14 04:01:43,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-14 04:01:43,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure abf550a2615219c173635cf0cb0963a0, server=jenkins-hbase4.apache.org,39261,1694664063868 in 173 msec 2023-09-14 04:01:43,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5ebd4b9f4e687e38af590d1df067e28, ASSIGN in 336 msec 2023-09-14 04:01:43,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-14 04:01:43,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=abf550a2615219c173635cf0cb0963a0, ASSIGN in 337 msec 2023-09-14 04:01:43,841 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 04:01:43,841 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664103841"}]},"ts":"1694664103841"} 2023-09-14 04:01:43,843 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-14 04:01:43,845 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 04:01:43,845 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-14 04:01:43,847 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-14 04:01:43,848 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:43,848 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:43,848 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:43,848 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:01:43,850 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:43,850 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:43,850 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:43,850 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-14 04:01:43,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 404 msec 2023-09-14 04:01:44,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-14 04:01:44,056 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-14 04:01:44,058 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-14 04:01:44,058 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:44,060 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:01:44,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 04:01:44,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664104072 (current time:1694664104072). 2023-09-14 04:01:44,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:01:44,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x0e750383 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:44,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f9d24d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:44,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:44,084 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59108, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:44,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e750383 to 127.0.0.1:64527 2023-09-14 04:01:44,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:44,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x065e60c6 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:44,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20911295, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:44,095 DEBUG [hconnection-0x46cc01e8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:44,097 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:44,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:44,103 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:44,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x065e60c6 to 127.0.0.1:64527 2023-09-14 04:01:44,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:44,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-14 04:01:44,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:01:44,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 04:01:44,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 04:01:44,109 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 04:01:44,109 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694664704109 2023-09-14 04:01:44,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 04:01:44,109 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-14 04:01:44,111 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:01:44,111 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:01:44,112 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 04:01:44,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 04:01:44,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-14 04:01:44,114 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 04:01:44,115 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694664704115 2023-09-14 04:01:44,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,126 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-14 04:01:44,126 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:44,127 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-14 04:01:44,127 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-14 04:01:44,128 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,128 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,130 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,130 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,130 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,130 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,130 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,130 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,131 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,131 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:01:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-14 04:01:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,132 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 04:01:44,132 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:44,132 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 04:01:44,132 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:44,132 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,133 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 04:01:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 04:01:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-14 04:01:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-14 04:01:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 04:01:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-14 04:01:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:44,135 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-14 04:01:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 04:01:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-14 04:01:44,138 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-14 04:01:44,139 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,139 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,139 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,140 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,140 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,141 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-14 04:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78256a66[Count = 1] remaining members to acquire global barrier 2023-09-14 04:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-14 04:01:44,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78256a66[Count = 0] remaining members to acquire global barrier 2023-09-14 04:01:44,144 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-14 04:01:44,144 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,145 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,145 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,145 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,145 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 04:01:44,146 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,146 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:44,146 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:44,146 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:44,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,146 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 04:01:44,146 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 04:01:44,146 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-14 04:01:44,146 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,146 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:01:44,146 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:44,146 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:44,146 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. started... 2023-09-14 04:01:44,146 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:44,146 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:01:44,146 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. started... 2023-09-14 04:01:44,146 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5ebd4b9f4e687e38af590d1df067e28: 2023-09-14 04:01:44,147 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for abf550a2615219c173635cf0cb0963a0: 2023-09-14 04:01:44,147 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,148 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:44,148 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,148 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:01:44,148 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:44,149 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:01:44,156 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 04:01:44,156 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:44,156 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-14 04:01:44,163 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. completed. 2023-09-14 04:01:44,163 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-14 04:01:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:01:44,165 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. completed. 2023-09-14 04:01:44,165 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-14 04:01:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:01:44,166 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,166 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 04:01:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,166 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:44,166 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-14 04:01:44,168 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,168 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 04:01:44,168 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:44,168 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-14 04:01:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:01:44,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-14 04:01:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:01:44,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-14 04:01:44,176 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-14 04:01:44,176 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:01:44,176 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:01:44,176 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,176 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:01:44,177 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,177 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,177 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,177 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,177 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,177 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,178 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,178 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,179 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,179 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,181 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,181 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,182 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,185 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,185 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,185 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,185 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,185 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,186 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:44,185 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,186 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,186 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,186 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,188 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-14 04:01:44,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,185 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:01:44,187 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,188 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,188 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,188 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,188 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,188 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,188 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,189 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 04:01:44,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,196 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,211 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:44,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-14 04:01:44,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:01:44,212 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:01:44,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-14 04:01:44,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,216 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-14 04:01:44,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694664104110Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694664104196 (+86 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694664104196Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694664104196Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694664104200 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694664104208 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694664104216 (+8 ms) 2023-09-14 04:01:44,219 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 04:01:44,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 109 msec 2023-09-14 04:01:44,412 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:44,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-14 04:01:44,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:01:44,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34905] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:01:44,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39261] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:01:44,420 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-14 04:01:44,421 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:44,421 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:01:44,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 04:01:44,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664104431 (current time:1694664104431). 2023-09-14 04:01:44,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:01:44,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x2069e1de to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:44,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c504241, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:44,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:44,446 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:44,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2069e1de to 127.0.0.1:64527 2023-09-14 04:01:44,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:44,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x46dd6c97 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:01:44,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29550283, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:01:44,455 DEBUG [hconnection-0x67590fa2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:44,458 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:44,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:01:44,464 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:01:44,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46dd6c97 to 127.0.0.1:64527 2023-09-14 04:01:44,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:01:44,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-14 04:01:44,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:01:44,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 04:01:44,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 04:01:44,470 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 04:01:44,471 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694664704471 2023-09-14 04:01:44,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-14 04:01:44,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-14 04:01:44,472 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:01:44,472 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:01:44,474 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-14 04:01:44,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 04:01:44,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-14 04:01:44,476 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 04:01:44,477 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694664704477 2023-09-14 04:01:44,493 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-14 04:01:44,493 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-14 04:01:44,493 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:44,495 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-14 04:01:44,495 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-14 04:01:44,495 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,495 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,497 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,498 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,498 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,498 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,498 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:01:44,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-14 04:01:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,499 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 04:01:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-14 04:01:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,499 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-14 04:01:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-14 04:01:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 04:01:44,499 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:44,499 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 04:01:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 04:01:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-14 04:01:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,500 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-14 04:01:44,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-14 04:01:44,501 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-14 04:01:44,501 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 04:01:44,501 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 04:01:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-14 04:01:44,502 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-14 04:01:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-14 04:01:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-14 04:01:44,502 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:01:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-14 04:01:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-14 04:01:44,503 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-14 04:01:44,504 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,505 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,505 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,506 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:44,506 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 04:01:44,507 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:01:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-14 04:01:44,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ef33bc0[Count = 1] remaining members to acquire global barrier 2023-09-14 04:01:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 04:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-14 04:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ef33bc0[Count = 0] remaining members to acquire global barrier 2023-09-14 04:01:44,511 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-14 04:01:44,511 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,512 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,513 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,513 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,513 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,513 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 04:01:44,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,513 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 04:01:44,513 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-14 04:01:44,513 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-14 04:01:44,513 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:01:44,513 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:44,514 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:44,514 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:01:44,514 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:01:44,514 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:44,514 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,514 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:01:44,514 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:44,514 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. started... 2023-09-14 04:01:44,514 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. started... 2023-09-14 04:01:44,514 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b5ebd4b9f4e687e38af590d1df067e28 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-14 04:01:44,514 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2745): Flushing abf550a2615219c173635cf0cb0963a0 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-14 04:01:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 04:01:44,515 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:44,516 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-14 04:01:44,543 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230914be2a91aa8db34f4dbbc3f629327408f1 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230914be2a91aa8db34f4dbbc3f629327408f1 2023-09-14 04:01:44,546 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230914a1dc278052cc4a4f861fd74535c379d6 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914a1dc278052cc4a4f861fd74535c379d6 2023-09-14 04:01:44,561 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/.tmp/cf/479f1333d1094f059b303efaa2f367e1 2023-09-14 04:01:44,567 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/.tmp/cf/479f1333d1094f059b303efaa2f367e1 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/cf/479f1333d1094f059b303efaa2f367e1 2023-09-14 04:01:44,572 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/cf/479f1333d1094f059b303efaa2f367e1, entries=47, sequenceid=6, filesize=12.7 K 2023-09-14 04:01:44,573 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:44,574 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for abf550a2615219c173635cf0cb0963a0 in 59ms, sequenceid=6, compaction requested=false 2023-09-14 04:01:44,574 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-14 04:01:44,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-14 04:01:44,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:01:44,574 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:01:44,574 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for abf550a2615219c173635cf0cb0963a0: 2023-09-14 04:01:44,574 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-14 04:01:44,575 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:44,575 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/cf/479f1333d1094f059b303efaa2f367e1] hfiles 2023-09-14 04:01:44,575 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/cf/479f1333d1094f059b303efaa2f367e1 for snapshot=snaptb0-testConsecutiveExports 2023-09-14 04:01:44,577 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/.tmp/cf/673c1613a5664b00b68d9d7e9472cdd7 2023-09-14 04:01:44,583 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/.tmp/cf/673c1613a5664b00b68d9d7e9472cdd7 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/cf/673c1613a5664b00b68d9d7e9472cdd7 2023-09-14 04:01:44,589 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. completed. 2023-09-14 04:01:44,589 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:01:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-14 04:01:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:01:44,591 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,591 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 04:01:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,591 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/cf/673c1613a5664b00b68d9d7e9472cdd7, entries=3, sequenceid=6, filesize=5.4 K 2023-09-14 04:01:44,591 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:44,591 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-14 04:01:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,594 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for b5ebd4b9f4e687e38af590d1df067e28 in 80ms, sequenceid=6, compaction requested=false 2023-09-14 04:01:44,596 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5ebd4b9f4e687e38af590d1df067e28: 2023-09-14 04:01:44,596 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-14 04:01:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 04:01:44,596 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:01:44,596 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/cf/673c1613a5664b00b68d9d7e9472cdd7] hfiles 2023-09-14 04:01:44,596 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/cf/673c1613a5664b00b68d9d7e9472cdd7 for snapshot=snaptb0-testConsecutiveExports 2023-09-14 04:01:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 04:01:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:01:44,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-14 04:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. completed. 2023-09-14 04:01:44,604 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:01:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:01:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:01:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-14 04:01:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:01:44,607 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-14 04:01:44,607 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,607 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,607 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-14 04:01:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 04:01:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 04:01:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:01:44,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-14 04:01:44,612 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-14 04:01:44,612 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:01:44,612 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:01:44,612 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-14 04:01:44,612 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:01:44,614 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,614 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,614 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:01:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:01:44,614 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,614 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,614 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,615 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:01:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,615 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 04:01:44,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,615 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:01:44,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,616 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 04:01:44,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:01:44,618 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-14 04:01:44,618 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,619 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,623 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,624 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,624 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,624 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:01:44,624 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,624 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,624 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,625 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-14 04:01:44,624 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:01:44,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-14 04:01:44,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,626 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,626 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,626 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:01:44,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-14 04:01:44,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:01:44,626 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:01:44,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:01:44,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:01:44,626 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,627 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:01:44,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:01:44,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:01:44,627 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:01:44,627 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,627 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230914be2a91aa8db34f4dbbc3f629327408f1, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914a1dc278052cc4a4f861fd74535c379d6] mob files 2023-09-14 04:01:44,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230914be2a91aa8db34f4dbbc3f629327408f1 2023-09-14 04:01:44,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914a1dc278052cc4a4f861fd74535c379d6 2023-09-14 04:01:44,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-14 04:01:44,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,656 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-14 04:01:44,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,657 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694664104471Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694664104637 (+166 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694664104637Loading Region manifests for snaptb0-testConsecutiveExports at 1694664104637Writing data manifest for snaptb0-testConsecutiveExports at 1694664104640 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694664104648 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694664104656 (+8 ms) 2023-09-14 04:01:44,659 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-14 04:01:44,661 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 188 msec 2023-09-14 04:01:44,774 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:01:44,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-14 04:01:44,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:01:44,776 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776 2023-09-14 04:01:44,776 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776, srcFsUri=hdfs://localhost:43181, srcDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:44,797 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:44,797 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@39ada167, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,797 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33, snapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-14 04:01:44,806 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 04:01:44,817 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:44,818 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:44,818 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:44,818 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:45,715 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-3215380571298531001.jar 2023-09-14 04:01:45,715 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:45,716 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:45,782 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-4332961310969847878.jar 2023-09-14 04:01:45,782 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:45,782 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:45,783 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:45,783 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:45,784 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:45,784 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:45,784 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 04:01:45,785 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 04:01:45,785 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 04:01:45,785 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 04:01:45,786 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 04:01:45,786 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 04:01:45,787 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 04:01:45,787 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 04:01:45,787 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 04:01:45,788 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 04:01:45,788 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:45,789 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:45,789 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:45,790 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:45,790 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:45,790 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:45,791 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:46,192 WARN [Listener at jenkins-hbase4.apache.org/37059] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 04:01:46,195 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-14 04:01:46,197 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-14 04:01:48,029 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:01:48,029 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:01:48,032 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0002_000001 (auth:SIMPLE) 2023-09-14 04:01:48,705 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 04:01:48,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0003_000001 (auth:SIMPLE) 2023-09-14 04:01:52,518 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0003_000001 (auth:SIMPLE) 2023-09-14 04:01:54,735 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0003_000001 (auth:SIMPLE) 2023-09-14 04:01:57,028 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0003_000001 (auth:SIMPLE) 2023-09-14 04:01:58,364 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 04:01:58,364 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 04:01:58,368 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-14 04:01:58,369 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 04:01:58,369 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 04:01:58,369 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 04:01:58,372 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-14 04:01:58,372 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-14 04:01:58,372 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@34159686 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 04:01:58,373 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-14 04:01:58,373 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-14 04:01:58,374 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776, srcFsUri=hdfs://localhost:43181, srcDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:58,395 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:01:58,395 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6f977aaa, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 04:01:58,395 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33, snapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-14 04:01:58,407 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-14 04:01:58,420 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:58,420 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:58,421 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:58,421 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:59,287 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-294307501304780085.jar 2023-09-14 04:01:59,288 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:59,288 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:59,354 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-1560688280210317399.jar 2023-09-14 04:01:59,354 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:59,354 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:59,355 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:59,355 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:59,356 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:59,356 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 04:01:59,356 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 04:01:59,357 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 04:01:59,357 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 04:01:59,358 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 04:01:59,358 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 04:01:59,359 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 04:01:59,359 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 04:01:59,359 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 04:01:59,360 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 04:01:59,360 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 04:01:59,361 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:59,361 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:59,362 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:59,362 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:59,362 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:01:59,363 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:59,363 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:01:59,724 WARN [Listener at jenkins-hbase4.apache.org/37059] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 04:01:59,726 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-14 04:01:59,728 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-14 04:02:03,214 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:02:03,214 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:02:03,217 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0003_000001 (auth:SIMPLE) 2023-09-14 04:02:04,040 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0004_000001 (auth:SIMPLE) 2023-09-14 04:02:07,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0004_000001 (auth:SIMPLE) 2023-09-14 04:02:09,937 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0004_000001 (auth:SIMPLE) 2023-09-14 04:02:12,170 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0004_000001 (auth:SIMPLE) 2023-09-14 04:02:13,928 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 04:02:13,928 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 04:02:13,931 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-14 04:02:13,932 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 04:02:13,932 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 04:02:13,932 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 04:02:13,935 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-14 04:02:13,935 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-14 04:02:13,935 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@34159686 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-14 04:02:13,936 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-14 04:02:13,936 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/local-export-1694664104776/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-14 04:02:13,948 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-14 04:02:13,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-14 04:02:13,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-14 04:02:13,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-14 04:02:13,953 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664133953"}]},"ts":"1694664133953"} 2023-09-14 04:02:13,955 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-14 04:02:13,957 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-14 04:02:13,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5ebd4b9f4e687e38af590d1df067e28, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=abf550a2615219c173635cf0cb0963a0, UNASSIGN}] 2023-09-14 04:02:13,960 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5ebd4b9f4e687e38af590d1df067e28, UNASSIGN 2023-09-14 04:02:13,960 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=abf550a2615219c173635cf0cb0963a0, UNASSIGN 2023-09-14 04:02:13,960 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b5ebd4b9f4e687e38af590d1df067e28, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:13,961 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=abf550a2615219c173635cf0cb0963a0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:13,961 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664133960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664133960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664133960"}]},"ts":"1694664133960"} 2023-09-14 04:02:13,961 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664133961"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664133961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664133961"}]},"ts":"1694664133961"} 2023-09-14 04:02:13,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure b5ebd4b9f4e687e38af590d1df067e28, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:02:13,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure abf550a2615219c173635cf0cb0963a0, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:02:14,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-14 04:02:14,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:02:14,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close abf550a2615219c173635cf0cb0963a0 2023-09-14 04:02:14,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5ebd4b9f4e687e38af590d1df067e28, disabling compactions & flushes 2023-09-14 04:02:14,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:02:14,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing abf550a2615219c173635cf0cb0963a0, disabling compactions & flushes 2023-09-14 04:02:14,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:02:14,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:02:14,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. after waiting 0 ms 2023-09-14 04:02:14,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:02:14,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:02:14,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. after waiting 0 ms 2023-09-14 04:02:14,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:02:14,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:02:14,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:02:14,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:14,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:14,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0. 2023-09-14 04:02:14,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28. 2023-09-14 04:02:14,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for abf550a2615219c173635cf0cb0963a0: 2023-09-14 04:02:14,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5ebd4b9f4e687e38af590d1df067e28: 2023-09-14 04:02:14,133 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed abf550a2615219c173635cf0cb0963a0 2023-09-14 04:02:14,133 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=abf550a2615219c173635cf0cb0963a0, regionState=CLOSED 2023-09-14 04:02:14,134 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664134133"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664134133"}]},"ts":"1694664134133"} 2023-09-14 04:02:14,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:02:14,134 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=b5ebd4b9f4e687e38af590d1df067e28, regionState=CLOSED 2023-09-14 04:02:14,134 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694664134134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664134134"}]},"ts":"1694664134134"} 2023-09-14 04:02:14,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-14 04:02:14,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure abf550a2615219c173635cf0cb0963a0, server=jenkins-hbase4.apache.org,39261,1694664063868 in 172 msec 2023-09-14 04:02:14,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-14 04:02:14,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure b5ebd4b9f4e687e38af590d1df067e28, server=jenkins-hbase4.apache.org,34905,1694664063818 in 174 msec 2023-09-14 04:02:14,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=abf550a2615219c173635cf0cb0963a0, UNASSIGN in 180 msec 2023-09-14 04:02:14,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-14 04:02:14,139 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5ebd4b9f4e687e38af590d1df067e28, UNASSIGN in 181 msec 2023-09-14 04:02:14,140 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664134140"}]},"ts":"1694664134140"} 2023-09-14 04:02:14,141 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-14 04:02:14,144 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-14 04:02:14,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 195 msec 2023-09-14 04:02:14,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-14 04:02:14,256 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-14 04:02:14,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-14 04:02:14,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 04:02:14,260 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 04:02:14,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-14 04:02:14,261 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 04:02:14,264 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-14 04:02:14,267 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 04:02:14,267 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 04:02:14,267 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:02:14,267 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 04:02:14,267 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 04:02:14,268 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-14 04:02:14,268 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-14 04:02:14,268 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-14 04:02:14,269 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:14,269 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-14 04:02:14,269 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-14 04:02:14,269 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/recovered.edits] 2023-09-14 04:02:14,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-14 04:02:14,267 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0 2023-09-14 04:02:14,269 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 04:02:14,269 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 04:02:14,269 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-14 04:02:14,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:14,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:14,272 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:14,275 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/recovered.edits] 2023-09-14 04:02:14,276 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/cf/673c1613a5664b00b68d9d7e9472cdd7 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/cf/673c1613a5664b00b68d9d7e9472cdd7 2023-09-14 04:02:14,279 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/cf/479f1333d1094f059b303efaa2f367e1 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/cf/479f1333d1094f059b303efaa2f367e1 2023-09-14 04:02:14,280 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28/recovered.edits/9.seqid 2023-09-14 04:02:14,281 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/b5ebd4b9f4e687e38af590d1df067e28 2023-09-14 04:02:14,283 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0/recovered.edits/9.seqid 2023-09-14 04:02:14,283 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testConsecutiveExports/abf550a2615219c173635cf0cb0963a0 2023-09-14 04:02:14,283 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-14 04:02:14,284 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-14 04:02:14,285 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-14 04:02:14,288 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230914be2a91aa8db34f4dbbc3f629327408f1 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230914be2a91aa8db34f4dbbc3f629327408f1 2023-09-14 04:02:14,290 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914a1dc278052cc4a4f861fd74535c379d6 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230914a1dc278052cc4a4f861fd74535c379d6 2023-09-14 04:02:14,290 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-14 04:02:14,292 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 04:02:14,295 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-14 04:02:14,297 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-14 04:02:14,298 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 04:02:14,298 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-14 04:02:14,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664134298"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:14,299 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664134298"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:14,300 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 04:02:14,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b5ebd4b9f4e687e38af590d1df067e28, NAME => 'testtb-testConsecutiveExports,,1694664103446.b5ebd4b9f4e687e38af590d1df067e28.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => abf550a2615219c173635cf0cb0963a0, NAME => 'testtb-testConsecutiveExports,1,1694664103446.abf550a2615219c173635cf0cb0963a0.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 04:02:14,301 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-14 04:02:14,301 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694664134301"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:14,302 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-14 04:02:14,306 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-14 04:02:14,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 49 msec 2023-09-14 04:02:14,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-14 04:02:14,373 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-14 04:02:14,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-14 04:02:14,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-14 04:02:14,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-14 04:02:14,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-14 04:02:14,410 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=744 (was 762), OpenFileDescriptor=902 (was 933), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=218 (was 236), ProcessCount=168 (was 168), AvailableMemoryMB=8651 (was 8844) 2023-09-14 04:02:14,410 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-09-14 04:02:14,429 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=744, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=218, ProcessCount=168, AvailableMemoryMB=8650 2023-09-14 04:02:14,429 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=744 is superior to 500 2023-09-14 04:02:14,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 04:02:14,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:14,434 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 04:02:14,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-14 04:02:14,435 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 04:02:14,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-14 04:02:14,438 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168 2023-09-14 04:02:14,438 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:14,438 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168 empty. 2023-09-14 04:02:14,438 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7 empty. 2023-09-14 04:02:14,439 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168 2023-09-14 04:02:14,439 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:14,439 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-14 04:02:14,448 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-14 04:02:14,449 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec17f836b9078503fe209cd728370168, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:02:14,450 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => b98d4fdb337d48ea7d20b05e7492b1a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:02:14,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:14,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:14,457 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing b98d4fdb337d48ea7d20b05e7492b1a7, disabling compactions & flushes 2023-09-14 04:02:14,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing ec17f836b9078503fe209cd728370168, disabling compactions & flushes 2023-09-14 04:02:14,458 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:14,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:14,458 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:14,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:14,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. after waiting 0 ms 2023-09-14 04:02:14,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:14,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. after waiting 0 ms 2023-09-14 04:02:14,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:14,458 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:14,458 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:14,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for b98d4fdb337d48ea7d20b05e7492b1a7: 2023-09-14 04:02:14,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for ec17f836b9078503fe209cd728370168: 2023-09-14 04:02:14,460 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 04:02:14,461 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664134461"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664134461"}]},"ts":"1694664134461"} 2023-09-14 04:02:14,461 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664134461"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664134461"}]},"ts":"1694664134461"} 2023-09-14 04:02:14,467 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 04:02:14,468 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 04:02:14,468 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664134468"}]},"ts":"1694664134468"} 2023-09-14 04:02:14,469 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-14 04:02:14,472 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:02:14,474 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:02:14,474 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:02:14,474 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:02:14,474 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:02:14,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec17f836b9078503fe209cd728370168, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b98d4fdb337d48ea7d20b05e7492b1a7, ASSIGN}] 2023-09-14 04:02:14,476 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec17f836b9078503fe209cd728370168, ASSIGN 2023-09-14 04:02:14,476 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b98d4fdb337d48ea7d20b05e7492b1a7, ASSIGN 2023-09-14 04:02:14,477 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec17f836b9078503fe209cd728370168, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39305,1694664063904; forceNewPlan=false, retain=false 2023-09-14 04:02:14,477 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b98d4fdb337d48ea7d20b05e7492b1a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39261,1694664063868; forceNewPlan=false, retain=false 2023-09-14 04:02:14,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-14 04:02:14,627 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 04:02:14,630 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ec17f836b9078503fe209cd728370168, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:14,630 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b98d4fdb337d48ea7d20b05e7492b1a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:14,630 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664134630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664134630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664134630"}]},"ts":"1694664134630"} 2023-09-14 04:02:14,630 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664134630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664134630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664134630"}]},"ts":"1694664134630"} 2023-09-14 04:02:14,632 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure ec17f836b9078503fe209cd728370168, server=jenkins-hbase4.apache.org,39305,1694664063904}] 2023-09-14 04:02:14,633 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure b98d4fdb337d48ea7d20b05e7492b1a7, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:02:14,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-14 04:02:14,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:14,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b98d4fdb337d48ea7d20b05e7492b1a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 04:02:14,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:14,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec17f836b9078503fe209cd728370168, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 04:02:14,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. service=AccessControlService 2023-09-14 04:02:14,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. service=AccessControlService 2023-09-14 04:02:14,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:02:14,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:02:14,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:14,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ec17f836b9078503fe209cd728370168 2023-09-14 04:02:14,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:14,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:14,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:14,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ec17f836b9078503fe209cd728370168 2023-09-14 04:02:14,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:14,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ec17f836b9078503fe209cd728370168 2023-09-14 04:02:14,795 INFO [StoreOpener-b98d4fdb337d48ea7d20b05e7492b1a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:14,795 INFO [StoreOpener-ec17f836b9078503fe209cd728370168-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec17f836b9078503fe209cd728370168 2023-09-14 04:02:14,797 DEBUG [StoreOpener-b98d4fdb337d48ea7d20b05e7492b1a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/cf 2023-09-14 04:02:14,797 DEBUG [StoreOpener-ec17f836b9078503fe209cd728370168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/cf 2023-09-14 04:02:14,797 DEBUG [StoreOpener-ec17f836b9078503fe209cd728370168-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/cf 2023-09-14 04:02:14,797 DEBUG [StoreOpener-b98d4fdb337d48ea7d20b05e7492b1a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/cf 2023-09-14 04:02:14,798 INFO [StoreOpener-ec17f836b9078503fe209cd728370168-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec17f836b9078503fe209cd728370168 columnFamilyName cf 2023-09-14 04:02:14,798 INFO [StoreOpener-b98d4fdb337d48ea7d20b05e7492b1a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b98d4fdb337d48ea7d20b05e7492b1a7 columnFamilyName cf 2023-09-14 04:02:14,799 INFO [StoreOpener-b98d4fdb337d48ea7d20b05e7492b1a7-1] regionserver.HStore(310): Store=b98d4fdb337d48ea7d20b05e7492b1a7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:02:14,799 INFO [StoreOpener-ec17f836b9078503fe209cd728370168-1] regionserver.HStore(310): Store=ec17f836b9078503fe209cd728370168/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:02:14,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:14,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168 2023-09-14 04:02:14,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:14,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168 2023-09-14 04:02:14,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ec17f836b9078503fe209cd728370168 2023-09-14 04:02:14,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:14,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:02:14,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ec17f836b9078503fe209cd728370168; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66424296, jitterRate=-0.010200858116149902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:02:14,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:02:14,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ec17f836b9078503fe209cd728370168: 2023-09-14 04:02:14,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b98d4fdb337d48ea7d20b05e7492b1a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58763460, jitterRate=-0.124356210231781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:02:14,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b98d4fdb337d48ea7d20b05e7492b1a7: 2023-09-14 04:02:14,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168., pid=60, masterSystemTime=1694664134785 2023-09-14 04:02:14,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7., pid=61, masterSystemTime=1694664134785 2023-09-14 04:02:14,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:14,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:14,820 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ec17f836b9078503fe209cd728370168, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:14,820 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664134820"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664134820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664134820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664134820"}]},"ts":"1694664134820"} 2023-09-14 04:02:14,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:14,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:14,821 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b98d4fdb337d48ea7d20b05e7492b1a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:14,821 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664134821"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664134821"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664134821"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664134821"}]},"ts":"1694664134821"} 2023-09-14 04:02:14,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-14 04:02:14,824 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure ec17f836b9078503fe209cd728370168, server=jenkins-hbase4.apache.org,39305,1694664063904 in 190 msec 2023-09-14 04:02:14,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-14 04:02:14,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec17f836b9078503fe209cd728370168, ASSIGN in 350 msec 2023-09-14 04:02:14,826 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure b98d4fdb337d48ea7d20b05e7492b1a7, server=jenkins-hbase4.apache.org,39261,1694664063868 in 190 msec 2023-09-14 04:02:14,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-14 04:02:14,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b98d4fdb337d48ea7d20b05e7492b1a7, ASSIGN in 351 msec 2023-09-14 04:02:14,828 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 04:02:14,828 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664134828"}]},"ts":"1694664134828"} 2023-09-14 04:02:14,829 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-14 04:02:14,832 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 04:02:14,832 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-14 04:02:14,834 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-14 04:02:14,836 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:14,836 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:14,836 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:14,836 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:14,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:14,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:14,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:14,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:14,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 407 msec 2023-09-14 04:02:15,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-14 04:02:15,039 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-14 04:02:15,041 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,041 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:15,044 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:02:15,052 DEBUG [hconnection-0x162add54-shared-pool-22] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:15,059 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:15,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 04:02:15,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664135064 (current time:1694664135064). 2023-09-14 04:02:15,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:02:15,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x41c0d7eb to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:15,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fffc233, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:15,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:15,075 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:15,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41c0d7eb to 127.0.0.1:64527 2023-09-14 04:02:15,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:15,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x282dba3e to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:15,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f955f5f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:15,085 DEBUG [hconnection-0x2ebae6c4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:15,086 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53132, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:15,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:15,092 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:15,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x282dba3e to 127.0.0.1:64527 2023-09-14 04:02:15,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:15,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-14 04:02:15,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:02:15,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 04:02:15,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 04:02:15,097 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 04:02:15,097 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694664735097 2023-09-14 04:02:15,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 04:02:15,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,099 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:02:15,099 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:02:15,100 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 04:02:15,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 04:02:15,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-14 04:02:15,101 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 04:02:15,102 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694664735102 2023-09-14 04:02:15,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,110 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-14 04:02:15,110 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:15,111 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-14 04:02:15,111 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-14 04:02:15,112 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,112 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,113 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,113 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,113 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,113 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,114 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,114 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,114 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,115 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:02:15,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-14 04:02:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-14 04:02:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,115 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 04:02:15,115 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 04:02:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-14 04:02:15,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 04:02:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 04:02:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:15,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,116 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 04:02:15,116 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 04:02:15,115 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:15,117 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 04:02:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 04:02:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 04:02:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 04:02:15,117 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 04:02:15,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 04:02:15,118 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:15,119 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 04:02:15,119 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 04:02:15,119 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 04:02:15,120 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,120 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,120 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,123 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,123 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,123 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,123 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:15,123 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,123 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:15,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,124 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,124 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:15,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-14 04:02:15,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9191c03[Count = 1] remaining members to acquire global barrier 2023-09-14 04:02:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-14 04:02:15,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9191c03[Count = 0] remaining members to acquire global barrier 2023-09-14 04:02:15,127 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-14 04:02:15,127 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,128 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,128 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,128 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,128 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 04:02:15,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,129 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 04:02:15,129 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 04:02:15,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,129 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,129 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 04:02:15,129 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:02:15,129 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:15,129 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:15,129 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:15,129 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:15,129 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,129 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:15,129 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:02:15,129 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:15,129 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. started... 2023-09-14 04:02:15,129 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. started... 2023-09-14 04:02:15,130 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec17f836b9078503fe209cd728370168: 2023-09-14 04:02:15,130 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b98d4fdb337d48ea7d20b05e7492b1a7: 2023-09-14 04:02:15,131 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,131 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,131 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:15,131 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:15,131 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:02:15,131 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:02:15,133 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 04:02:15,133 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:15,133 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 04:02:15,140 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. completed. 2023-09-14 04:02:15,140 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:15,140 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. completed. 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:15,140 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:02:15,140 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:02:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 04:02:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:15,143 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 04:02:15,143 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 04:02:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,144 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,144 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:15,144 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 04:02:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:02:15,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-14 04:02:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39305,1694664063904': 2023-09-14 04:02:15,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-14 04:02:15,151 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-14 04:02:15,151 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:02:15,151 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:02:15,151 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,152 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:02:15,153 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,153 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,153 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,153 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,153 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,153 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,153 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,154 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,154 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,155 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,157 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,157 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,157 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,161 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,161 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,161 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:15,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,160 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,163 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,163 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,163 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:02:15,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,163 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,163 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,163 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,163 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,163 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 04:02:15,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-14 04:02:15,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,198 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694664135098Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694664135174 (+76 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694664135174Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694664135174Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694664135177 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694664135189 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694664135198 (+9 ms) 2023-09-14 04:02:15,200 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:15,201 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 04:02:15,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-14 04:02:15,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:02:15,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 103 msec 2023-09-14 04:02:15,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39305] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:02:15,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39261] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:02:15,208 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,208 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:15,208 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:02:15,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 04:02:15,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664135218 (current time:1694664135218). 2023-09-14 04:02:15,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:02:15,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x491a318a to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:15,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@196bf2ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:15,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:15,230 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53134, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:15,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x491a318a to 127.0.0.1:64527 2023-09-14 04:02:15,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:15,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x0a6027f2 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:15,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12eed155, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:15,238 DEBUG [hconnection-0x54d4bd76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:15,240 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:15,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:15,246 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:15,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a6027f2 to 127.0.0.1:64527 2023-09-14 04:02:15,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:15,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-14 04:02:15,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:02:15,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 04:02:15,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 04:02:15,251 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 04:02:15,252 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694664735252 2023-09-14 04:02:15,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-14 04:02:15,252 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,253 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:02:15,253 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:02:15,254 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-14 04:02:15,254 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 04:02:15,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-14 04:02:15,256 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 04:02:15,257 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694664735257 2023-09-14 04:02:15,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,266 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-14 04:02:15,266 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:15,267 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-14 04:02:15,267 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-14 04:02:15,267 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,267 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,269 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,269 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,269 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,269 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,269 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,269 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,270 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,270 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 04:02:15,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-14 04:02:15,271 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,271 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 04:02:15,271 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,271 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,271 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 04:02:15,271 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-14 04:02:15,271 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:15,271 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:15,272 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 04:02:15,273 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 04:02:15,273 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 04:02:15,271 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:15,273 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 04:02:15,273 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-14 04:02:15,273 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 04:02:15,274 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 04:02:15,273 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-14 04:02:15,274 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-14 04:02:15,281 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,281 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,281 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,281 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:15,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,282 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:15,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-14 04:02:15,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17170f4e[Count = 1] remaining members to acquire global barrier 2023-09-14 04:02:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-14 04:02:15,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17170f4e[Count = 0] remaining members to acquire global barrier 2023-09-14 04:02:15,286 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-14 04:02:15,286 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,287 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,287 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,287 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,288 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 04:02:15,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 04:02:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-14 04:02:15,288 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,288 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:02:15,288 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:15,288 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 04:02:15,288 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. started... 2023-09-14 04:02:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:02:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:15,288 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. started... 2023-09-14 04:02:15,289 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ec17f836b9078503fe209cd728370168 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-14 04:02:15,289 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b98d4fdb337d48ea7d20b05e7492b1a7 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-14 04:02:15,290 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 04:02:15,290 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:15,290 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 04:02:15,306 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230914bf6ad7a8c9db49ed857c05ddf5e5ac8d to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914bf6ad7a8c9db49ed857c05ddf5e5ac8d 2023-09-14 04:02:15,306 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230914c2f86aec4ec041b1a2de5a55c789da5d to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230914c2f86aec4ec041b1a2de5a55c789da5d 2023-09-14 04:02:15,314 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/.tmp/cf/53749a0bbf8a4406b9086d99afdf4669 2023-09-14 04:02:15,314 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/.tmp/cf/638ae727e3d54628bf58be651153a27a 2023-09-14 04:02:15,319 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/.tmp/cf/638ae727e3d54628bf58be651153a27a as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/cf/638ae727e3d54628bf58be651153a27a 2023-09-14 04:02:15,319 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/.tmp/cf/53749a0bbf8a4406b9086d99afdf4669 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/cf/53749a0bbf8a4406b9086d99afdf4669 2023-09-14 04:02:15,324 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/cf/638ae727e3d54628bf58be651153a27a, entries=5, sequenceid=6, filesize=5.8 K 2023-09-14 04:02:15,324 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/cf/53749a0bbf8a4406b9086d99afdf4669, entries=45, sequenceid=6, filesize=13.2 K 2023-09-14 04:02:15,325 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for ec17f836b9078503fe209cd728370168 in 37ms, sequenceid=6, compaction requested=false 2023-09-14 04:02:15,325 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for b98d4fdb337d48ea7d20b05e7492b1a7 in 36ms, sequenceid=6, compaction requested=false 2023-09-14 04:02:15,325 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-14 04:02:15,325 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec17f836b9078503fe209cd728370168: 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b98d4fdb337d48ea7d20b05e7492b1a7: 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/cf/638ae727e3d54628bf58be651153a27a] hfiles 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/cf/53749a0bbf8a4406b9086d99afdf4669] hfiles 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/cf/638ae727e3d54628bf58be651153a27a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,328 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/cf/53749a0bbf8a4406b9086d99afdf4669 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,335 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. completed. 2023-09-14 04:02:15,335 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:15,335 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. completed. 2023-09-14 04:02:15,335 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:15,335 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:15,336 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,335 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:15,336 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 04:02:15,336 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:15,336 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:15,336 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,336 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:02:15,336 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-14 04:02:15,336 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:02:15,338 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,338 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 04:02:15,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,338 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:15,338 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,338 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 04:02:15,338 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-14 04:02:15,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,340 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:15,340 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-14 04:02:15,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:02:15,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-14 04:02:15,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39305,1694664063904': 2023-09-14 04:02:15,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-14 04:02:15,347 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-14 04:02:15,347 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:02:15,347 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:02:15,347 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,347 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:02:15,352 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,352 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:15,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,352 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,352 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,352 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,353 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,352 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,352 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,353 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:15,354 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,354 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-14 04:02:15,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:02:15,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,355 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:02:15,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:15,355 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,356 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,356 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,359 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,359 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,359 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,360 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,360 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:15,360 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,359 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,360 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:15,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,360 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:15,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:15,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:15,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,360 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,362 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:02:15,362 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,362 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,362 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,362 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,362 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:15,362 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,362 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:15,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:15,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230914c2f86aec4ec041b1a2de5a55c789da5d, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914bf6ad7a8c9db49ed857c05ddf5e5ac8d] mob files 2023-09-14 04:02:15,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230914c2f86aec4ec041b1a2de5a55c789da5d 2023-09-14 04:02:15,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914bf6ad7a8c9db49ed857c05ddf5e5ac8d 2023-09-14 04:02:15,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,390 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-14 04:02:15,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,390 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:15,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694664135252Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694664135370 (+118 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694664135370Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694664135370Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694664135373 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694664135382 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694664135390 (+8 ms) 2023-09-14 04:02:15,393 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-14 04:02:15,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 140 msec 2023-09-14 04:02:15,555 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:15,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-14 04:02:15,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:02:15,588 DEBUG [Listener at jenkins-hbase4.apache.org/37059] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 04:02:15,591 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 04:02:15,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34905] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-14 04:02:15,593 DEBUG [Listener at jenkins-hbase4.apache.org/37059] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 04:02:15,597 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 04:02:15,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39261] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-14 04:02:15,597 DEBUG [Listener at jenkins-hbase4.apache.org/37059] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-14 04:02:15,600 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-14 04:02:15,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39305] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-14 04:02:15,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-14 04:02:15,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:15,605 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 04:02:15,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-14 04:02:15,606 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 04:02:15,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-14 04:02:15,608 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:15,608 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:15,608 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002 empty. 2023-09-14 04:02:15,608 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63 empty. 2023-09-14 04:02:15,609 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:15,609 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:15,609 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-14 04:02:15,618 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-14 04:02:15,619 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 119b3e7596e4efa95c3077152ce49002, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:02:15,619 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => d82e6564c12c8d36d4991f24f64dcc63, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:02:15,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:15,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:15,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 119b3e7596e4efa95c3077152ce49002, disabling compactions & flushes 2023-09-14 04:02:15,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing d82e6564c12c8d36d4991f24f64dcc63, disabling compactions & flushes 2023-09-14 04:02:15,628 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:15,628 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:15,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:15,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:15,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. after waiting 0 ms 2023-09-14 04:02:15,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:15,628 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. after waiting 0 ms 2023-09-14 04:02:15,629 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:15,629 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:15,629 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 119b3e7596e4efa95c3077152ce49002: 2023-09-14 04:02:15,629 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:15,629 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for d82e6564c12c8d36d4991f24f64dcc63: 2023-09-14 04:02:15,631 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 04:02:15,632 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664135632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664135632"}]},"ts":"1694664135632"} 2023-09-14 04:02:15,632 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664135632"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664135632"}]},"ts":"1694664135632"} 2023-09-14 04:02:15,634 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 04:02:15,635 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 04:02:15,635 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664135635"}]},"ts":"1694664135635"} 2023-09-14 04:02:15,637 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-14 04:02:15,640 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:02:15,642 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:02:15,642 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:02:15,642 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:02:15,642 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:02:15,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119b3e7596e4efa95c3077152ce49002, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d82e6564c12c8d36d4991f24f64dcc63, ASSIGN}] 2023-09-14 04:02:15,645 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d82e6564c12c8d36d4991f24f64dcc63, ASSIGN 2023-09-14 04:02:15,645 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119b3e7596e4efa95c3077152ce49002, ASSIGN 2023-09-14 04:02:15,646 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d82e6564c12c8d36d4991f24f64dcc63, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39261,1694664063868; forceNewPlan=false, retain=false 2023-09-14 04:02:15,646 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119b3e7596e4efa95c3077152ce49002, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34905,1694664063818; forceNewPlan=false, retain=false 2023-09-14 04:02:15,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-14 04:02:15,796 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 04:02:15,799 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=119b3e7596e4efa95c3077152ce49002, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,799 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d82e6564c12c8d36d4991f24f64dcc63, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,799 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664135798"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664135798"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664135798"}]},"ts":"1694664135798"} 2023-09-14 04:02:15,799 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664135798"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664135798"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664135798"}]},"ts":"1694664135798"} 2023-09-14 04:02:15,801 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 119b3e7596e4efa95c3077152ce49002, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:02:15,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure d82e6564c12c8d36d4991f24f64dcc63, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:02:15,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-14 04:02:15,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 119b3e7596e4efa95c3077152ce49002, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.', STARTKEY => '', ENDKEY => '2'} 2023-09-14 04:02:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. service=AccessControlService 2023-09-14 04:02:15,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:15,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:02:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d82e6564c12c8d36d4991f24f64dcc63, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.', STARTKEY => '2', ENDKEY => ''} 2023-09-14 04:02:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:15,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. service=AccessControlService 2023-09-14 04:02:15,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:15,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:15,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:02:15,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:15,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:15,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:15,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:15,958 INFO [StoreOpener-119b3e7596e4efa95c3077152ce49002-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:15,958 INFO [StoreOpener-d82e6564c12c8d36d4991f24f64dcc63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:15,959 DEBUG [StoreOpener-119b3e7596e4efa95c3077152ce49002-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/cf 2023-09-14 04:02:15,959 DEBUG [StoreOpener-119b3e7596e4efa95c3077152ce49002-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/cf 2023-09-14 04:02:15,959 DEBUG [StoreOpener-d82e6564c12c8d36d4991f24f64dcc63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/cf 2023-09-14 04:02:15,959 DEBUG [StoreOpener-d82e6564c12c8d36d4991f24f64dcc63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/cf 2023-09-14 04:02:15,960 INFO [StoreOpener-119b3e7596e4efa95c3077152ce49002-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 119b3e7596e4efa95c3077152ce49002 columnFamilyName cf 2023-09-14 04:02:15,960 INFO [StoreOpener-d82e6564c12c8d36d4991f24f64dcc63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d82e6564c12c8d36d4991f24f64dcc63 columnFamilyName cf 2023-09-14 04:02:15,960 INFO [StoreOpener-119b3e7596e4efa95c3077152ce49002-1] regionserver.HStore(310): Store=119b3e7596e4efa95c3077152ce49002/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:02:15,960 INFO [StoreOpener-d82e6564c12c8d36d4991f24f64dcc63-1] regionserver.HStore(310): Store=d82e6564c12c8d36d4991f24f64dcc63/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:02:15,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:15,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:15,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:15,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:15,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:15,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:15,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:02:15,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:02:15,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d82e6564c12c8d36d4991f24f64dcc63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64949012, jitterRate=-0.03218430280685425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:02:15,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d82e6564c12c8d36d4991f24f64dcc63: 2023-09-14 04:02:15,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 119b3e7596e4efa95c3077152ce49002; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61384797, jitterRate=-0.08529524505138397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:02:15,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 119b3e7596e4efa95c3077152ce49002: 2023-09-14 04:02:15,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63., pid=70, masterSystemTime=1694664135953 2023-09-14 04:02:15,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002., pid=69, masterSystemTime=1694664135952 2023-09-14 04:02:15,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:15,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:15,970 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d82e6564c12c8d36d4991f24f64dcc63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:15,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:15,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:15,970 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664135970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664135970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664135970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664135970"}]},"ts":"1694664135970"} 2023-09-14 04:02:15,970 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=119b3e7596e4efa95c3077152ce49002, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:15,971 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664135970"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664135970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664135970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664135970"}]},"ts":"1694664135970"} 2023-09-14 04:02:15,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-14 04:02:15,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure d82e6564c12c8d36d4991f24f64dcc63, server=jenkins-hbase4.apache.org,39261,1694664063868 in 170 msec 2023-09-14 04:02:15,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-14 04:02:15,974 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 119b3e7596e4efa95c3077152ce49002, server=jenkins-hbase4.apache.org,34905,1694664063818 in 171 msec 2023-09-14 04:02:15,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d82e6564c12c8d36d4991f24f64dcc63, ASSIGN in 331 msec 2023-09-14 04:02:15,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-14 04:02:15,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119b3e7596e4efa95c3077152ce49002, ASSIGN in 332 msec 2023-09-14 04:02:15,976 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 04:02:15,977 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664135977"}]},"ts":"1694664135977"} 2023-09-14 04:02:15,978 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-14 04:02:15,980 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 04:02:15,981 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-14 04:02:15,982 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-14 04:02:15,984 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:15,984 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:15,984 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:15,984 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:15,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:15,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:15,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:15,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:15,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:15,986 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:15,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:15,987 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:15,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 384 msec 2023-09-14 04:02:16,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-14 04:02:16,210 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-14 04:02:16,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 119b3e7596e4efa95c3077152ce49002, d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:16,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[119b3e7596e4efa95c3077152ce49002, d82e6564c12c8d36d4991f24f64dcc63], force=true 2023-09-14 04:02:16,244 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[119b3e7596e4efa95c3077152ce49002, d82e6564c12c8d36d4991f24f64dcc63], force=true 2023-09-14 04:02:16,244 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[119b3e7596e4efa95c3077152ce49002, d82e6564c12c8d36d4991f24f64dcc63], force=true 2023-09-14 04:02:16,244 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[119b3e7596e4efa95c3077152ce49002, d82e6564c12c8d36d4991f24f64dcc63], force=true 2023-09-14 04:02:16,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 04:02:16,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119b3e7596e4efa95c3077152ce49002, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d82e6564c12c8d36d4991f24f64dcc63, UNASSIGN}] 2023-09-14 04:02:16,268 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119b3e7596e4efa95c3077152ce49002, UNASSIGN 2023-09-14 04:02:16,269 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d82e6564c12c8d36d4991f24f64dcc63, UNASSIGN 2023-09-14 04:02:16,269 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=119b3e7596e4efa95c3077152ce49002, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:16,269 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d82e6564c12c8d36d4991f24f64dcc63, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:16,270 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664136269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664136269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664136269"}]},"ts":"1694664136269"} 2023-09-14 04:02:16,270 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664136269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664136269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664136269"}]},"ts":"1694664136269"} 2023-09-14 04:02:16,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure d82e6564c12c8d36d4991f24f64dcc63, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:02:16,272 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 119b3e7596e4efa95c3077152ce49002, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:02:16,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 04:02:16,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:16,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d82e6564c12c8d36d4991f24f64dcc63, disabling compactions & flushes 2023-09-14 04:02:16,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:16,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:16,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. after waiting 0 ms 2023-09-14 04:02:16,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:16,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d82e6564c12c8d36d4991f24f64dcc63 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-14 04:02:16,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:16,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 119b3e7596e4efa95c3077152ce49002, disabling compactions & flushes 2023-09-14 04:02:16,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:16,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:16,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. after waiting 0 ms 2023-09-14 04:02:16,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:16,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 119b3e7596e4efa95c3077152ce49002 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-14 04:02:16,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/.tmp/cf/9471ad86b8394daf8fc92da9565ca826 2023-09-14 04:02:16,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/.tmp/cf/913395006e8f48c1b2e21fe29b327676 2023-09-14 04:02:16,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/.tmp/cf/9471ad86b8394daf8fc92da9565ca826 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/cf/9471ad86b8394daf8fc92da9565ca826 2023-09-14 04:02:16,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/cf/9471ad86b8394daf8fc92da9565ca826, entries=1, sequenceid=5, filesize=4.7 K 2023-09-14 04:02:16,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d82e6564c12c8d36d4991f24f64dcc63 in 24ms, sequenceid=5, compaction requested=false 2023-09-14 04:02:16,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-14 04:02:16,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/.tmp/cf/913395006e8f48c1b2e21fe29b327676 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/cf/913395006e8f48c1b2e21fe29b327676 2023-09-14 04:02:16,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-14 04:02:16,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:16,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63. 2023-09-14 04:02:16,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d82e6564c12c8d36d4991f24f64dcc63: 2023-09-14 04:02:16,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/cf/913395006e8f48c1b2e21fe29b327676, entries=1, sequenceid=5, filesize=4.7 K 2023-09-14 04:02:16,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:16,459 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d82e6564c12c8d36d4991f24f64dcc63, regionState=CLOSED 2023-09-14 04:02:16,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 119b3e7596e4efa95c3077152ce49002 in 32ms, sequenceid=5, compaction requested=false 2023-09-14 04:02:16,460 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664136459"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664136459"}]},"ts":"1694664136459"} 2023-09-14 04:02:16,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=73 2023-09-14 04:02:16,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure d82e6564c12c8d36d4991f24f64dcc63, server=jenkins-hbase4.apache.org,39261,1694664063868 in 193 msec 2023-09-14 04:02:16,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-14 04:02:16,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:16,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d82e6564c12c8d36d4991f24f64dcc63, UNASSIGN in 200 msec 2023-09-14 04:02:16,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002. 2023-09-14 04:02:16,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 119b3e7596e4efa95c3077152ce49002: 2023-09-14 04:02:16,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:16,468 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=119b3e7596e4efa95c3077152ce49002, regionState=CLOSED 2023-09-14 04:02:16,469 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694664136468"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664136468"}]},"ts":"1694664136468"} 2023-09-14 04:02:16,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=72 2023-09-14 04:02:16,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 119b3e7596e4efa95c3077152ce49002, server=jenkins-hbase4.apache.org,34905,1694664063818 in 198 msec 2023-09-14 04:02:16,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-14 04:02:16,473 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=119b3e7596e4efa95c3077152ce49002, UNASSIGN in 208 msec 2023-09-14 04:02:16,520 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-14 04:02:16,522 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135602.119b3e7596e4efa95c3077152ce49002.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:16,522 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694664135602.d82e6564c12c8d36d4991f24f64dcc63.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:16,522 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:16,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 04:02:16,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=82d5e43e89fc7f92d7ebcf58f07e9957, ASSIGN}] 2023-09-14 04:02:16,574 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=82d5e43e89fc7f92d7ebcf58f07e9957, ASSIGN 2023-09-14 04:02:16,575 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=82d5e43e89fc7f92d7ebcf58f07e9957, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,34905,1694664063818; forceNewPlan=false, retain=false 2023-09-14 04:02:16,725 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-14 04:02:16,727 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=82d5e43e89fc7f92d7ebcf58f07e9957, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:16,727 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694664136727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664136727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664136727"}]},"ts":"1694664136727"} 2023-09-14 04:02:16,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 82d5e43e89fc7f92d7ebcf58f07e9957, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:02:16,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 04:02:16,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. 2023-09-14 04:02:16,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82d5e43e89fc7f92d7ebcf58f07e9957, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.', STARTKEY => '', ENDKEY => ''} 2023-09-14 04:02:16,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. service=AccessControlService 2023-09-14 04:02:16,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:02:16,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:16,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:16,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:16,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:16,886 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/.regioninfo 2023-09-14 04:02:16,894 INFO [StoreOpener-82d5e43e89fc7f92d7ebcf58f07e9957-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:16,895 DEBUG [StoreOpener-82d5e43e89fc7f92d7ebcf58f07e9957-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf 2023-09-14 04:02:16,895 DEBUG [StoreOpener-82d5e43e89fc7f92d7ebcf58f07e9957-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf 2023-09-14 04:02:16,895 INFO [StoreOpener-82d5e43e89fc7f92d7ebcf58f07e9957-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82d5e43e89fc7f92d7ebcf58f07e9957 columnFamilyName cf 2023-09-14 04:02:16,922 DEBUG [StoreOpener-82d5e43e89fc7f92d7ebcf58f07e9957-1] regionserver.HStore(539): loaded hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/913395006e8f48c1b2e21fe29b327676.119b3e7596e4efa95c3077152ce49002->hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/cf/913395006e8f48c1b2e21fe29b327676-top 2023-09-14 04:02:16,927 DEBUG [StoreOpener-82d5e43e89fc7f92d7ebcf58f07e9957-1] regionserver.HStore(539): loaded hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/9471ad86b8394daf8fc92da9565ca826.d82e6564c12c8d36d4991f24f64dcc63->hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/cf/9471ad86b8394daf8fc92da9565ca826-top 2023-09-14 04:02:16,928 INFO [StoreOpener-82d5e43e89fc7f92d7ebcf58f07e9957-1] regionserver.HStore(310): Store=82d5e43e89fc7f92d7ebcf58f07e9957/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:02:16,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:16,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:16,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:16,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 82d5e43e89fc7f92d7ebcf58f07e9957; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66920605, jitterRate=-0.002805277705192566}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:02:16,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 82d5e43e89fc7f92d7ebcf58f07e9957: 2023-09-14 04:02:16,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957., pid=77, masterSystemTime=1694664136881 2023-09-14 04:02:16,934 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.,because compaction is disabled. 2023-09-14 04:02:16,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. 2023-09-14 04:02:16,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. 2023-09-14 04:02:16,936 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=82d5e43e89fc7f92d7ebcf58f07e9957, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:16,936 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694664136936"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664136936"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664136936"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664136936"}]},"ts":"1694664136936"} 2023-09-14 04:02:16,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-14 04:02:16,939 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 82d5e43e89fc7f92d7ebcf58f07e9957, server=jenkins-hbase4.apache.org,34905,1694664063818 in 209 msec 2023-09-14 04:02:16,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-14 04:02:16,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=82d5e43e89fc7f92d7ebcf58f07e9957, ASSIGN in 366 msec 2023-09-14 04:02:16,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[119b3e7596e4efa95c3077152ce49002, d82e6564c12c8d36d4991f24f64dcc63], force=true in 705 msec 2023-09-14 04:02:17,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-14 04:02:17,350 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-14 04:02:17,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-14 04:02:17,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664137351 (current time:1694664137351). 2023-09-14 04:02:17,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:02:17,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x4879cb1f to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:17,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b91bd7e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:17,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:17,363 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54462, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:17,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4879cb1f to 127.0.0.1:64527 2023-09-14 04:02:17,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:17,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x7b499951 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:17,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d6e9414, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:17,371 DEBUG [hconnection-0x5b32bc8a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:17,374 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:17,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:17,379 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:17,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b499951 to 127.0.0.1:64527 2023-09-14 04:02:17,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:17,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-14 04:02:17,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:02:17,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-14 04:02:17,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-14 04:02:17,384 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-14 04:02:17,385 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694664737385 2023-09-14 04:02:17,385 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-14 04:02:17,388 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:02:17,388 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:02:17,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-14 04:02:17,389 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-14 04:02:17,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-14 04:02:17,391 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-14 04:02:17,392 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694664737392 2023-09-14 04:02:17,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,405 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-14 04:02:17,405 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:17,407 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-14 04:02:17,407 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-14 04:02:17,409 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,409 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,410 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:17,410 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:17,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:17,410 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,410 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:17,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:17,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:17,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:17,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:17,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:17,411 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,411 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:02:17,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,412 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-14 04:02:17,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,412 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:17,412 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-14 04:02:17,412 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-14 04:02:17,414 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:17,414 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-14 04:02:17,415 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-14 04:02:17,415 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-14 04:02:17,414 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:17,415 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-14 04:02:17,416 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-14 04:02:17,415 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-14 04:02:17,416 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-14 04:02:17,416 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-14 04:02:17,416 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-14 04:02:17,417 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,418 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,418 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,418 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:17,418 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,418 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:17,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:17,418 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,418 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:17,418 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,418 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:17,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:17,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:17,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:17,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:17,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-14 04:02:17,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44b23190[Count = 0] remaining members to acquire global barrier 2023-09-14 04:02:17,421 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-14 04:02:17,421 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,423 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,423 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,423 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,423 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-14 04:02:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,423 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,424 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:02:17,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,424 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-14 04:02:17,424 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-14 04:02:17,424 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-14 04:02:17,424 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-14 04:02:17,424 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:02:17,424 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:02:17,424 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:17,424 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:17,424 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. 2023-09-14 04:02:17,424 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. started... 2023-09-14 04:02:17,425 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 82d5e43e89fc7f92d7ebcf58f07e9957: 2023-09-14 04:02:17,426 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,426 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:17,426 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/913395006e8f48c1b2e21fe29b327676.119b3e7596e4efa95c3077152ce49002->hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/cf/913395006e8f48c1b2e21fe29b327676-top, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/9471ad86b8394daf8fc92da9565ca826.d82e6564c12c8d36d4991f24f64dcc63->hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/cf/9471ad86b8394daf8fc92da9565ca826-top] hfiles 2023-09-14 04:02:17,426 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/913395006e8f48c1b2e21fe29b327676.119b3e7596e4efa95c3077152ce49002 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,427 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/9471ad86b8394daf8fc92da9565ca826.d82e6564c12c8d36d4991f24f64dcc63 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,427 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-14 04:02:17,427 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-14 04:02:17,427 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:17,427 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:17,427 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-14 04:02:17,428 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-14 04:02:17,441 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. completed. 2023-09-14 04:02:17,441 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. 2023-09-14 04:02:17,441 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:17,441 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:17,441 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,441 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-14 04:02:17,441 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:02:17,446 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-14 04:02:17,446 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,446 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:17,447 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-14 04:02:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:17,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:17,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:17,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:02:17,450 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-14 04:02:17,450 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-14 04:02:17,450 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:02:17,450 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:02:17,450 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,450 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:02:17,452 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:17,452 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:17,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,452 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:17,452 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:17,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:17,453 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:17,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:17,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:17,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,453 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:17,453 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:17,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:17,487 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:17,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,492 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:17,492 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:17,494 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:17,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-14 04:02:17,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:02:17,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:17,494 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:02:17,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:17,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:17,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:17,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:17,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:17,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:17,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:17,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:17,497 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,497 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:17,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:17,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:17,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:17,498 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:17,498 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,498 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:17,498 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,498 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:17,498 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:17,498 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,498 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:17,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:17,498 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:17,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:17,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:17,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:17,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:17,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,519 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-14 04:02:17,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,520 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694664137385Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694664137497 (+112 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694664137497Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694664137502 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694664137512 (+10 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694664137519 (+7 ms) 2023-09-14 04:02:17,523 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-14 04:02:17,524 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 135 msec 2023-09-14 04:02:17,695 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:17,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-14 04:02:17,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:02:17,696 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696 2023-09-14 04:02:17,696 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43181, tgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696, rawTgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696, srcFsUri=hdfs://localhost:43181, srcDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:02:17,718 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:02:17,718 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_407841438_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,718 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33, snapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-14 04:02:17,727 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:17,742 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:17,742 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:17,742 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:17,743 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:18,348 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0004_000001 (auth:SIMPLE) 2023-09-14 04:02:18,624 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-3205690945482411164.jar 2023-09-14 04:02:18,624 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:18,625 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:18,691 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-5429640362606579220.jar 2023-09-14 04:02:18,691 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:18,691 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:18,692 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:18,692 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:18,693 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:18,693 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:18,693 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 04:02:18,694 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 04:02:18,694 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 04:02:18,694 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 04:02:18,695 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 04:02:18,695 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 04:02:18,696 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 04:02:18,696 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 04:02:18,696 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 04:02:18,697 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 04:02:18,697 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:18,698 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:18,698 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:02:18,698 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:18,699 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:18,699 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:02:18,700 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:02:19,043 WARN [Listener at jenkins-hbase4.apache.org/37059] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 04:02:19,045 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-14 04:02:19,047 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-14 04:02:19,102 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:02:19,102 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:02:19,225 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0005_000001 (auth:SIMPLE) 2023-09-14 04:02:19,704 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 04:02:22,969 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0005_000001 (auth:SIMPLE) 2023-09-14 04:02:25,188 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0005_000001 (auth:SIMPLE) 2023-09-14 04:02:27,557 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0005_000001 (auth:SIMPLE) 2023-09-14 04:02:29,212 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 04:02:29,215 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 04:02:29,224 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,224 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 04:02:29,224 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 04:02:29,225 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,225 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-14 04:02:29,225 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-14 04:02:29,225 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,226 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-14 04:02:29,226 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664137696/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-14 04:02:29,233 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-14 04:02:29,238 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664149238"}]},"ts":"1694664149238"} 2023-09-14 04:02:29,239 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-14 04:02:29,241 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-14 04:02:29,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=82d5e43e89fc7f92d7ebcf58f07e9957, UNASSIGN}] 2023-09-14 04:02:29,244 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=82d5e43e89fc7f92d7ebcf58f07e9957, UNASSIGN 2023-09-14 04:02:29,244 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=82d5e43e89fc7f92d7ebcf58f07e9957, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:29,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694664149244"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664149244"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664149244"}]},"ts":"1694664149244"} 2023-09-14 04:02:29,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 82d5e43e89fc7f92d7ebcf58f07e9957, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:02:29,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-14 04:02:29,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:29,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 82d5e43e89fc7f92d7ebcf58f07e9957, disabling compactions & flushes 2023-09-14 04:02:29,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. 2023-09-14 04:02:29,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. 2023-09-14 04:02:29,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. after waiting 0 ms 2023-09-14 04:02:29,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. 2023-09-14 04:02:29,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-14 04:02:29,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:29,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957. 2023-09-14 04:02:29,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 82d5e43e89fc7f92d7ebcf58f07e9957: 2023-09-14 04:02:29,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:29,412 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=82d5e43e89fc7f92d7ebcf58f07e9957, regionState=CLOSED 2023-09-14 04:02:29,412 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694664149412"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664149412"}]},"ts":"1694664149412"} 2023-09-14 04:02:29,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-14 04:02:29,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 82d5e43e89fc7f92d7ebcf58f07e9957, server=jenkins-hbase4.apache.org,34905,1694664063818 in 167 msec 2023-09-14 04:02:29,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-14 04:02:29,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=82d5e43e89fc7f92d7ebcf58f07e9957, UNASSIGN in 173 msec 2023-09-14 04:02:29,417 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664149417"}]},"ts":"1694664149417"} 2023-09-14 04:02:29,418 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-14 04:02:29,419 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-14 04:02:29,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 187 msec 2023-09-14 04:02:29,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-14 04:02:29,540 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-14 04:02:29,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,544 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,545 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,546 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,549 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:29,549 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:29,549 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:29,550 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,550 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,550 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,550 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-14 04:02:29,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-14 04:02:29,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-14 04:02:29,551 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-14 04:02:29,551 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/recovered.edits] 2023-09-14 04:02:29,552 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/recovered.edits] 2023-09-14 04:02:29,552 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,552 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,552 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,552 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,552 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/recovered.edits] 2023-09-14 04:02:29,552 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:29,552 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:29,552 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:29,552 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:29,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:29,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-14 04:02:29,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:29,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:29,553 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:29,556 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/913395006e8f48c1b2e21fe29b327676.119b3e7596e4efa95c3077152ce49002 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/913395006e8f48c1b2e21fe29b327676.119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:29,556 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/cf/9471ad86b8394daf8fc92da9565ca826 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/cf/9471ad86b8394daf8fc92da9565ca826 2023-09-14 04:02:29,557 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/cf/913395006e8f48c1b2e21fe29b327676 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/cf/913395006e8f48c1b2e21fe29b327676 2023-09-14 04:02:29,558 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/9471ad86b8394daf8fc92da9565ca826.d82e6564c12c8d36d4991f24f64dcc63 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/cf/9471ad86b8394daf8fc92da9565ca826.d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:29,560 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/recovered.edits/8.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63/recovered.edits/8.seqid 2023-09-14 04:02:29,561 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d82e6564c12c8d36d4991f24f64dcc63 2023-09-14 04:02:29,561 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/recovered.edits/8.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002/recovered.edits/8.seqid 2023-09-14 04:02:29,561 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/119b3e7596e4efa95c3077152ce49002 2023-09-14 04:02:29,562 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/recovered.edits/12.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957/recovered.edits/12.seqid 2023-09-14 04:02:29,562 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/82d5e43e89fc7f92d7ebcf58f07e9957 2023-09-14 04:02:29,562 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-14 04:02:29,564 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,566 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-14 04:02:29,568 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-14 04:02:29,569 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,569 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-14 04:02:29,569 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664149569"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:29,571 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-14 04:02:29,571 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 82d5e43e89fc7f92d7ebcf58f07e9957, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694664135603.82d5e43e89fc7f92d7ebcf58f07e9957.', STARTKEY => '', ENDKEY => ''}] 2023-09-14 04:02:29,571 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-14 04:02:29,571 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694664149571"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:29,572 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-14 04:02:29,574 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:29,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-09-14 04:02:29,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-14 04:02:29,654 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-14 04:02:29,655 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-14 04:02:29,660 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664149660"}]},"ts":"1694664149660"} 2023-09-14 04:02:29,661 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-14 04:02:29,663 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-14 04:02:29,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec17f836b9078503fe209cd728370168, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b98d4fdb337d48ea7d20b05e7492b1a7, UNASSIGN}] 2023-09-14 04:02:29,665 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec17f836b9078503fe209cd728370168, UNASSIGN 2023-09-14 04:02:29,665 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b98d4fdb337d48ea7d20b05e7492b1a7, UNASSIGN 2023-09-14 04:02:29,666 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ec17f836b9078503fe209cd728370168, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:29,666 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b98d4fdb337d48ea7d20b05e7492b1a7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:29,666 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664149666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664149666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664149666"}]},"ts":"1694664149666"} 2023-09-14 04:02:29,666 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664149666"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664149666"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664149666"}]},"ts":"1694664149666"} 2023-09-14 04:02:29,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure ec17f836b9078503fe209cd728370168, server=jenkins-hbase4.apache.org,39305,1694664063904}] 2023-09-14 04:02:29,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure b98d4fdb337d48ea7d20b05e7492b1a7, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:02:29,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-14 04:02:29,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ec17f836b9078503fe209cd728370168 2023-09-14 04:02:29,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ec17f836b9078503fe209cd728370168, disabling compactions & flushes 2023-09-14 04:02:29,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:29,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:29,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. after waiting 0 ms 2023-09-14 04:02:29,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:29,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:29,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b98d4fdb337d48ea7d20b05e7492b1a7, disabling compactions & flushes 2023-09-14 04:02:29,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:29,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:29,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. after waiting 0 ms 2023-09-14 04:02:29,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:29,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:02:29,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:02:29,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:29,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:29,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168. 2023-09-14 04:02:29,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7. 2023-09-14 04:02:29,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ec17f836b9078503fe209cd728370168: 2023-09-14 04:02:29,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b98d4fdb337d48ea7d20b05e7492b1a7: 2023-09-14 04:02:29,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:29,837 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b98d4fdb337d48ea7d20b05e7492b1a7, regionState=CLOSED 2023-09-14 04:02:29,837 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664149837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664149837"}]},"ts":"1694664149837"} 2023-09-14 04:02:29,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ec17f836b9078503fe209cd728370168 2023-09-14 04:02:29,838 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ec17f836b9078503fe209cd728370168, regionState=CLOSED 2023-09-14 04:02:29,838 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694664149837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664149837"}]},"ts":"1694664149837"} 2023-09-14 04:02:29,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-14 04:02:29,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure b98d4fdb337d48ea7d20b05e7492b1a7, server=jenkins-hbase4.apache.org,39261,1694664063868 in 169 msec 2023-09-14 04:02:29,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-14 04:02:29,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure ec17f836b9078503fe209cd728370168, server=jenkins-hbase4.apache.org,39305,1694664063904 in 171 msec 2023-09-14 04:02:29,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b98d4fdb337d48ea7d20b05e7492b1a7, UNASSIGN in 177 msec 2023-09-14 04:02:29,842 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-14 04:02:29,842 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ec17f836b9078503fe209cd728370168, UNASSIGN in 178 msec 2023-09-14 04:02:29,843 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664149843"}]},"ts":"1694664149843"} 2023-09-14 04:02:29,844 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-14 04:02:29,846 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-14 04:02:29,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 192 msec 2023-09-14 04:02:29,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-14 04:02:29,962 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-14 04:02:29,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,966 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,967 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,968 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,971 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,971 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,971 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,971 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,971 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168 2023-09-14 04:02:29,971 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:29,971 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-14 04:02:29,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-14 04:02:29,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-14 04:02:29,972 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-14 04:02:29,972 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,972 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,972 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,972 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:29,972 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:29,972 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,973 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:29,972 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:29,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-14 04:02:29,973 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/recovered.edits] 2023-09-14 04:02:29,974 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/recovered.edits] 2023-09-14 04:02:29,977 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/cf/53749a0bbf8a4406b9086d99afdf4669 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/cf/53749a0bbf8a4406b9086d99afdf4669 2023-09-14 04:02:29,977 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/cf/638ae727e3d54628bf58be651153a27a to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/cf/638ae727e3d54628bf58be651153a27a 2023-09-14 04:02:29,980 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7/recovered.edits/9.seqid 2023-09-14 04:02:29,980 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168/recovered.edits/9.seqid 2023-09-14 04:02:29,980 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b98d4fdb337d48ea7d20b05e7492b1a7 2023-09-14 04:02:29,981 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ec17f836b9078503fe209cd728370168 2023-09-14 04:02:29,981 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-14 04:02:29,981 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-14 04:02:29,982 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-14 04:02:29,984 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230914c2f86aec4ec041b1a2de5a55c789da5d to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230914c2f86aec4ec041b1a2de5a55c789da5d 2023-09-14 04:02:29,986 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914bf6ad7a8c9db49ed857c05ddf5e5ac8d to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230914bf6ad7a8c9db49ed857c05ddf5e5ac8d 2023-09-14 04:02:29,986 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-14 04:02:29,988 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,989 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-14 04:02:29,991 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-14 04:02:29,992 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,992 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-14 04:02:29,992 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664149992"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:29,992 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664149992"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:29,994 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 04:02:29,994 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ec17f836b9078503fe209cd728370168, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694664134431.ec17f836b9078503fe209cd728370168.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b98d4fdb337d48ea7d20b05e7492b1a7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694664134431.b98d4fdb337d48ea7d20b05e7492b1a7.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 04:02:29,994 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-14 04:02:29,994 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694664149994"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:29,995 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-14 04:02:29,998 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:29,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 35 msec 2023-09-14 04:02:30,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-14 04:02:30,075 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-14 04:02:30,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-14 04:02:30,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:30,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-14 04:02:30,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-14 04:02:30,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-14 04:02:30,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-14 04:02:30,115 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 744) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:46126 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:50860 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3953 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:36189 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2130963952_1 at /127.0.0.1:50832 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:57804 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2130963952_1 at /127.0.0.1:57774 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 218) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=8563 (was 8650) 2023-09-14 04:02:30,115 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-14 04:02:30,134 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=168, AvailableMemoryMB=8562 2023-09-14 04:02:30,134 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-14 04:02:30,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 04:02:30,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 04:02:30,138 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 04:02:30,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-14 04:02:30,139 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 04:02:30,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-14 04:02:30,141 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:30,141 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:30,141 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb empty. 2023-09-14 04:02:30,141 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf empty. 2023-09-14 04:02:30,142 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:30,142 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:30,142 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-14 04:02:30,150 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-14 04:02:30,151 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 96253ef581f979fdaee5fab371c8a7fb, NAME => 'testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:02:30,151 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 79168faa51438ce0d37c106467bbedcf, NAME => 'testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 79168faa51438ce0d37c106467bbedcf, disabling compactions & flushes 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 96253ef581f979fdaee5fab371c8a7fb, disabling compactions & flushes 2023-09-14 04:02:30,159 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,159 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. after waiting 0 ms 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. after waiting 0 ms 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,159 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,159 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 79168faa51438ce0d37c106467bbedcf: 2023-09-14 04:02:30,159 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 96253ef581f979fdaee5fab371c8a7fb: 2023-09-14 04:02:30,161 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 04:02:30,162 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664150162"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664150162"}]},"ts":"1694664150162"} 2023-09-14 04:02:30,162 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664150162"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664150162"}]},"ts":"1694664150162"} 2023-09-14 04:02:30,163 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 04:02:30,164 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 04:02:30,164 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664150164"}]},"ts":"1694664150164"} 2023-09-14 04:02:30,165 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-14 04:02:30,168 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:02:30,169 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:02:30,169 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:02:30,169 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:02:30,170 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:02:30,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96253ef581f979fdaee5fab371c8a7fb, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79168faa51438ce0d37c106467bbedcf, ASSIGN}] 2023-09-14 04:02:30,172 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79168faa51438ce0d37c106467bbedcf, ASSIGN 2023-09-14 04:02:30,172 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96253ef581f979fdaee5fab371c8a7fb, ASSIGN 2023-09-14 04:02:30,173 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79168faa51438ce0d37c106467bbedcf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34905,1694664063818; forceNewPlan=false, retain=false 2023-09-14 04:02:30,173 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96253ef581f979fdaee5fab371c8a7fb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39261,1694664063868; forceNewPlan=false, retain=false 2023-09-14 04:02:30,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-14 04:02:30,323 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 04:02:30,326 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=79168faa51438ce0d37c106467bbedcf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,326 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=96253ef581f979fdaee5fab371c8a7fb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,326 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664150325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664150325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664150325"}]},"ts":"1694664150325"} 2023-09-14 04:02:30,326 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664150325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664150325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664150325"}]},"ts":"1694664150325"} 2023-09-14 04:02:30,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 79168faa51438ce0d37c106467bbedcf, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:02:30,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 96253ef581f979fdaee5fab371c8a7fb, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:02:30,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-14 04:02:30,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79168faa51438ce0d37c106467bbedcf, NAME => 'testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 04:02:30,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 96253ef581f979fdaee5fab371c8a7fb, NAME => 'testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 04:02:30,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. service=AccessControlService 2023-09-14 04:02:30,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. service=AccessControlService 2023-09-14 04:02:30,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:02:30,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:30,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:02:30,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:30,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:30,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:30,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:30,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:30,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:30,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:30,484 INFO [StoreOpener-96253ef581f979fdaee5fab371c8a7fb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:30,484 INFO [StoreOpener-79168faa51438ce0d37c106467bbedcf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:30,485 DEBUG [StoreOpener-79168faa51438ce0d37c106467bbedcf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/cf 2023-09-14 04:02:30,486 DEBUG [StoreOpener-96253ef581f979fdaee5fab371c8a7fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/cf 2023-09-14 04:02:30,486 DEBUG [StoreOpener-79168faa51438ce0d37c106467bbedcf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/cf 2023-09-14 04:02:30,486 DEBUG [StoreOpener-96253ef581f979fdaee5fab371c8a7fb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/cf 2023-09-14 04:02:30,486 INFO [StoreOpener-96253ef581f979fdaee5fab371c8a7fb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96253ef581f979fdaee5fab371c8a7fb columnFamilyName cf 2023-09-14 04:02:30,486 INFO [StoreOpener-79168faa51438ce0d37c106467bbedcf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79168faa51438ce0d37c106467bbedcf columnFamilyName cf 2023-09-14 04:02:30,487 INFO [StoreOpener-96253ef581f979fdaee5fab371c8a7fb-1] regionserver.HStore(310): Store=96253ef581f979fdaee5fab371c8a7fb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:02:30,487 INFO [StoreOpener-79168faa51438ce0d37c106467bbedcf-1] regionserver.HStore(310): Store=79168faa51438ce0d37c106467bbedcf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:02:30,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:30,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:30,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:30,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:30,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:30,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:30,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:02:30,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 96253ef581f979fdaee5fab371c8a7fb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73459301, jitterRate=0.09462888538837433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:02:30,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:02:30,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 96253ef581f979fdaee5fab371c8a7fb: 2023-09-14 04:02:30,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79168faa51438ce0d37c106467bbedcf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70573763, jitterRate=0.05163101851940155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:02:30,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79168faa51438ce0d37c106467bbedcf: 2023-09-14 04:02:30,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb., pid=94, masterSystemTime=1694664150479 2023-09-14 04:02:30,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf., pid=93, masterSystemTime=1694664150479 2023-09-14 04:02:30,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,497 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=96253ef581f979fdaee5fab371c8a7fb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,497 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664150497"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664150497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664150497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664150497"}]},"ts":"1694664150497"} 2023-09-14 04:02:30,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,497 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=79168faa51438ce0d37c106467bbedcf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,497 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664150497"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664150497"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664150497"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664150497"}]},"ts":"1694664150497"} 2023-09-14 04:02:30,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-14 04:02:30,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 96253ef581f979fdaee5fab371c8a7fb, server=jenkins-hbase4.apache.org,39261,1694664063868 in 170 msec 2023-09-14 04:02:30,500 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-14 04:02:30,500 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 79168faa51438ce0d37c106467bbedcf, server=jenkins-hbase4.apache.org,34905,1694664063818 in 172 msec 2023-09-14 04:02:30,501 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96253ef581f979fdaee5fab371c8a7fb, ASSIGN in 330 msec 2023-09-14 04:02:30,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-14 04:02:30,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79168faa51438ce0d37c106467bbedcf, ASSIGN in 330 msec 2023-09-14 04:02:30,502 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 04:02:30,502 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664150502"}]},"ts":"1694664150502"} 2023-09-14 04:02:30,503 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-14 04:02:30,506 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 04:02:30,506 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-14 04:02:30,507 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 04:02:30,509 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:30,509 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:30,509 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:30,509 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:30,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:30,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:30,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:30,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:30,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 376 msec 2023-09-14 04:02:30,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-14 04:02:30,743 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-14 04:02:30,745 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-14 04:02:30,745 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,748 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:02:30,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:02:30,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664150758 (current time:1694664150758). 2023-09-14 04:02:30,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:02:30,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x5ddf7054 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:30,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c6a2b4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:30,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:30,768 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:30,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ddf7054 to 127.0.0.1:64527 2023-09-14 04:02:30,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:30,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x78cf3d04 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:30,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e34bf99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:30,777 DEBUG [hconnection-0x5309d751-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:30,780 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58558, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:30,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:30,785 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:30,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78cf3d04 to 127.0.0.1:64527 2023-09-14 04:02:30,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:30,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 04:02:30,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:02:30,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:02:30,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:02:30,790 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:02:30,790 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694664750790 2023-09-14 04:02:30,790 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-14 04:02:30,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:02:30,792 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:02:30,792 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:02:30,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 04:02:30,792 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:02:30,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-14 04:02:30,796 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 04:02:30,797 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694664750797 2023-09-14 04:02:30,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,805 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-14 04:02:30,805 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:30,806 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-14 04:02:30,806 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-14 04:02:30,806 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,806 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,813 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:30,813 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:30,813 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:30,813 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:30,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:30,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:30,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:30,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:30,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:30,813 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,813 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,813 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,814 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 04:02:30,814 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 04:02:30,815 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:30,815 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:30,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,816 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 04:02:30,817 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 04:02:30,817 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:30,816 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 04:02:30,818 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 04:02:30,817 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 04:02:30,818 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 04:02:30,817 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 04:02:30,818 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 04:02:30,818 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 04:02:30,818 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 04:02:30,820 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,820 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:30,820 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,820 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:30,821 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,821 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:30,821 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,821 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,821 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:30,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:30,821 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,821 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:30,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-14 04:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23782ffd[Count = 1] remaining members to acquire global barrier 2023-09-14 04:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:30,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:30,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-14 04:02:30,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23782ffd[Count = 0] remaining members to acquire global barrier 2023-09-14 04:02:30,826 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-14 04:02:30,826 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,827 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,827 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,827 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,827 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:02:30,827 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,828 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:02:30,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,828 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,828 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:30,828 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:30,828 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,828 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:02:30,828 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,828 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:30,828 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. started... 2023-09-14 04:02:30,828 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:02:30,828 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. started... 2023-09-14 04:02:30,828 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:30,828 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 96253ef581f979fdaee5fab371c8a7fb: 2023-09-14 04:02:30,828 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 04:02:30,830 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79168faa51438ce0d37c106467bbedcf: 2023-09-14 04:02:30,830 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:02:30,830 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,830 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,830 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:30,830 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:30,830 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:02:30,830 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:02:30,832 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 04:02:30,832 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:30,832 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 04:02:30,840 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. completed. 2023-09-14 04:02:30,840 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. completed. 2023-09-14 04:02:30,840 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,840 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 04:02:30,841 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:02:30,843 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 04:02:30,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:30,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 04:02:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 04:02:30,843 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:30,843 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,844 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 04:02:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:30,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:02:30,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-14 04:02:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:30,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:02:30,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-14 04:02:30,850 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-14 04:02:30,850 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:02:30,850 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:02:30,850 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,850 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:02:30,852 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,852 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:30,852 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:30,852 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,852 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,852 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:30,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,852 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:30,853 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,853 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:30,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,853 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:30,855 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,855 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,856 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,858 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,858 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,858 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:30,858 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:30,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:30,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:30,858 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:30,858 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:30,858 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:30,858 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,859 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:30,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:30,858 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:30,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-14 04:02:30,860 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,860 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:30,860 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:30,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:30,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:30,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:30,860 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,860 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,860 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:30,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:02:30,860 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,861 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:30,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:30,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 04:02:30,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-14 04:02:30,892 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:30,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,892 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694664150790Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694664150867 (+77 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694664150867Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694664150867Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694664150870 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694664150885 (+15 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694664150892 (+7 ms) 2023-09-14 04:02:30,896 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 04:02:30,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 04:02:30,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:02:30,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 105 msec 2023-09-14 04:02:30,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39261] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:02:30,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34905] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:02:30,902 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-14 04:02:30,902 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,902 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:02:30,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:02:30,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664150911 (current time:1694664150911). 2023-09-14 04:02:30,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:02:30,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x0828ab67 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:30,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1506566c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:30,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:30,922 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:30,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0828ab67 to 127.0.0.1:64527 2023-09-14 04:02:30,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:30,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x2532050c to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:30,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@688ce15e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:30,930 DEBUG [hconnection-0x4f1e7f15-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:30,931 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:30,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:30,935 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:30,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2532050c to 127.0.0.1:64527 2023-09-14 04:02:30,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:30,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-14 04:02:30,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:02:30,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:02:30,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:02:30,940 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:02:30,940 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694664750940 2023-09-14 04:02:30,940 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-14 04:02:30,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-14 04:02:30,942 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:02:30,942 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:02:30,945 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-14 04:02:30,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 04:02:30,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-14 04:02:30,947 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 04:02:30,947 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694664750947 2023-09-14 04:02:30,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,956 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-14 04:02:30,956 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:30,957 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-14 04:02:30,957 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-14 04:02:30,957 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,957 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,959 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:30,959 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:30,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:30,959 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:30,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:30,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:30,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:30,959 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:30,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:30,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,959 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,960 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,960 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,960 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,960 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 04:02:30,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,961 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-14 04:02:30,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,961 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 04:02:30,961 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 04:02:30,961 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:30,961 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:30,965 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 04:02:30,965 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,965 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 04:02:30,965 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 04:02:30,965 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 04:02:30,966 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 04:02:30,966 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 04:02:30,965 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-14 04:02:30,966 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:30,969 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-14 04:02:30,969 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-14 04:02:30,969 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-14 04:02:30,970 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,970 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:30,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:30,970 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,971 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,971 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:30,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:30,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-14 04:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6240c695[Count = 1] remaining members to acquire global barrier 2023-09-14 04:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:30,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:30,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-14 04:02:30,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6240c695[Count = 0] remaining members to acquire global barrier 2023-09-14 04:02:30,976 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-14 04:02:30,976 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:02:30,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:30,982 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:02:30,982 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:30,982 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:30,982 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. started... 2023-09-14 04:02:30,982 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 04:02:30,982 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:02:30,982 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:30,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:30,982 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 96253ef581f979fdaee5fab371c8a7fb 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-14 04:02:30,982 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:30,982 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:02:30,982 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-14 04:02:30,983 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:30,983 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:30,983 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:30,983 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. started... 2023-09-14 04:02:30,983 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 79168faa51438ce0d37c106467bbedcf 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-14 04:02:30,984 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 04:02:30,984 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:30,984 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 04:02:31,001 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309147252a3c2cf244121a3cfb1d6a473eb31 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309147252a3c2cf244121a3cfb1d6a473eb31 2023-09-14 04:02:31,001 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230914a2a787278d164a7e8b9049054451b92f to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230914a2a787278d164a7e8b9049054451b92f 2023-09-14 04:02:31,009 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/.tmp/cf/da7735542b4e43258618f0c455194bb6 2023-09-14 04:02:31,009 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/.tmp/cf/31e5404e44cf4c75912e2968afe770d2 2023-09-14 04:02:31,015 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/.tmp/cf/31e5404e44cf4c75912e2968afe770d2 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/cf/31e5404e44cf4c75912e2968afe770d2 2023-09-14 04:02:31,015 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/.tmp/cf/da7735542b4e43258618f0c455194bb6 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/cf/da7735542b4e43258618f0c455194bb6 2023-09-14 04:02:31,019 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/cf/31e5404e44cf4c75912e2968afe770d2, entries=49, sequenceid=6, filesize=13.4 K 2023-09-14 04:02:31,020 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 79168faa51438ce0d37c106467bbedcf in 37ms, sequenceid=6, compaction requested=false 2023-09-14 04:02:31,020 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-14 04:02:31,021 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 79168faa51438ce0d37c106467bbedcf: 2023-09-14 04:02:31,021 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,023 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:31,023 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/cf/31e5404e44cf4c75912e2968afe770d2] hfiles 2023-09-14 04:02:31,023 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/cf/31e5404e44cf4c75912e2968afe770d2 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,023 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/cf/da7735542b4e43258618f0c455194bb6, entries=1, sequenceid=6, filesize=5.1 K 2023-09-14 04:02:31,024 INFO [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 96253ef581f979fdaee5fab371c8a7fb in 42ms, sequenceid=6, compaction requested=false 2023-09-14 04:02:31,026 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 96253ef581f979fdaee5fab371c8a7fb: 2023-09-14 04:02:31,026 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,026 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:31,026 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/cf/da7735542b4e43258618f0c455194bb6] hfiles 2023-09-14 04:02:31,026 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/cf/da7735542b4e43258618f0c455194bb6 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,037 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. completed. 2023-09-14 04:02:31,037 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,041 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 04:02:31,041 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:02:31,042 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:31,043 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,043 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 04:02:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:31,043 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:31,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 04:02:31,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:02:31,043 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 04:02:31,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:31,045 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. completed. 2023-09-14 04:02:31,045 DEBUG [rs(jenkins-hbase4.apache.org,39261,1694664063868)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:31,045 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:02:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:31,046 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:31,046 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:31,046 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,046 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-14 04:02:31,046 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:02:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,047 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-14 04:02:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-14 04:02:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:02:31,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-14 04:02:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39261,1694664063868': 2023-09-14 04:02:31,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-14 04:02:31,054 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-14 04:02:31,054 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:02:31,054 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:02:31,054 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,054 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:02:31,057 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:31,057 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:31,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,057 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:31,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:31,058 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:31,058 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,060 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:31,060 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,060 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:31,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:31,063 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:31,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:31,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-14 04:02:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:31,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:31,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:02:31,063 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:31,065 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:31,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:31,065 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,065 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:31,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:31,065 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:31,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:31,065 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,066 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230914a2a787278d164a7e8b9049054451b92f, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309147252a3c2cf244121a3cfb1d6a473eb31] mob files 2023-09-14 04:02:31,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230914a2a787278d164a7e8b9049054451b92f 2023-09-14 04:02:31,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309147252a3c2cf244121a3cfb1d6a473eb31 2023-09-14 04:02:31,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-14 04:02:31,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,093 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,093 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694664150941Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694664151074 (+133 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694664151074Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694664151074Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694664151078 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694664151086 (+8 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694664151093 (+7 ms) 2023-09-14 04:02:31,096 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-14 04:02:31,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 155 msec 2023-09-14 04:02:31,246 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:31,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-14 04:02:31,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:02:31,247 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247 2023-09-14 04:02:31,247 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43181, tgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247, rawTgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247, srcFsUri=hdfs://localhost:43181, srcDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:02:31,268 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:02:31,269 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1191478159_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,269 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33, snapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-14 04:02:31,274 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:31,291 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:31,291 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:31,292 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:31,292 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:32,158 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-6060187142850945557.jar 2023-09-14 04:02:32,159 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:32,159 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:32,225 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-6026454657398223872.jar 2023-09-14 04:02:32,225 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:32,226 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:32,226 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:32,226 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:32,227 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:32,227 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:32,227 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 04:02:32,228 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 04:02:32,228 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 04:02:32,228 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 04:02:32,229 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 04:02:32,229 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 04:02:32,229 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 04:02:32,230 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 04:02:32,230 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 04:02:32,231 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 04:02:32,231 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:32,231 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:32,232 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:02:32,232 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:32,232 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:32,233 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:02:32,233 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:02:32,582 WARN [Listener at jenkins-hbase4.apache.org/37059] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 04:02:32,584 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-14 04:02:33,728 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:02:33,728 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:02:33,730 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0005_000001 (auth:SIMPLE) 2023-09-14 04:02:34,360 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0006_000001 (auth:SIMPLE) 2023-09-14 04:02:35,013 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 04:02:38,060 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0006_000001 (auth:SIMPLE) 2023-09-14 04:02:40,912 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 04:02:40,913 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 04:02:40,918 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:40,918 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 04:02:40,919 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 04:02:40,919 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:40,919 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-14 04:02:40,919 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-14 04:02:40,919 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:40,920 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-14 04:02:40,920 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664151247/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-14 04:02:40,926 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-14 04:02:40,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-14 04:02:40,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 04:02:40,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-14 04:02:40,931 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664160931"}]},"ts":"1694664160931"} 2023-09-14 04:02:40,933 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-14 04:02:40,935 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-14 04:02:40,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96253ef581f979fdaee5fab371c8a7fb, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79168faa51438ce0d37c106467bbedcf, UNASSIGN}] 2023-09-14 04:02:40,938 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96253ef581f979fdaee5fab371c8a7fb, UNASSIGN 2023-09-14 04:02:40,938 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79168faa51438ce0d37c106467bbedcf, UNASSIGN 2023-09-14 04:02:40,939 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=96253ef581f979fdaee5fab371c8a7fb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:40,939 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=79168faa51438ce0d37c106467bbedcf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:40,939 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664160939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664160939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664160939"}]},"ts":"1694664160939"} 2023-09-14 04:02:40,939 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664160938"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664160938"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664160938"}]},"ts":"1694664160938"} 2023-09-14 04:02:40,940 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 96253ef581f979fdaee5fab371c8a7fb, server=jenkins-hbase4.apache.org,39261,1694664063868}] 2023-09-14 04:02:40,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 79168faa51438ce0d37c106467bbedcf, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:02:41,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-14 04:02:41,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:41,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:41,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 96253ef581f979fdaee5fab371c8a7fb, disabling compactions & flushes 2023-09-14 04:02:41,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79168faa51438ce0d37c106467bbedcf, disabling compactions & flushes 2023-09-14 04:02:41,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:41,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:41,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:41,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:41,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. after waiting 0 ms 2023-09-14 04:02:41,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:41,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. after waiting 0 ms 2023-09-14 04:02:41,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:41,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:02:41,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:02:41,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:41,101 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:41,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf. 2023-09-14 04:02:41,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb. 2023-09-14 04:02:41,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79168faa51438ce0d37c106467bbedcf: 2023-09-14 04:02:41,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 96253ef581f979fdaee5fab371c8a7fb: 2023-09-14 04:02:41,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:41,104 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=79168faa51438ce0d37c106467bbedcf, regionState=CLOSED 2023-09-14 04:02:41,104 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664161104"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664161104"}]},"ts":"1694664161104"} 2023-09-14 04:02:41,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:41,107 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=96253ef581f979fdaee5fab371c8a7fb, regionState=CLOSED 2023-09-14 04:02:41,107 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694664161107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664161107"}]},"ts":"1694664161107"} 2023-09-14 04:02:41,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-14 04:02:41,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 79168faa51438ce0d37c106467bbedcf, server=jenkins-hbase4.apache.org,34905,1694664063818 in 165 msec 2023-09-14 04:02:41,110 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=79168faa51438ce0d37c106467bbedcf, UNASSIGN in 172 msec 2023-09-14 04:02:41,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-14 04:02:41,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 96253ef581f979fdaee5fab371c8a7fb, server=jenkins-hbase4.apache.org,39261,1694664063868 in 169 msec 2023-09-14 04:02:41,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-14 04:02:41,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=96253ef581f979fdaee5fab371c8a7fb, UNASSIGN in 174 msec 2023-09-14 04:02:41,112 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664161112"}]},"ts":"1694664161112"} 2023-09-14 04:02:41,113 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-14 04:02:41,115 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-14 04:02:41,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 188 msec 2023-09-14 04:02:41,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-14 04:02:41,234 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-14 04:02:41,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,237 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,238 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,240 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,242 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,242 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,242 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,242 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-14 04:02:41,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-14 04:02:41,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-14 04:02:41,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-14 04:02:41,243 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:41,243 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:41,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:41,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:41,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:41,245 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:41,246 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/recovered.edits] 2023-09-14 04:02:41,246 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/recovered.edits] 2023-09-14 04:02:41,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-14 04:02:41,251 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/cf/31e5404e44cf4c75912e2968afe770d2 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/cf/31e5404e44cf4c75912e2968afe770d2 2023-09-14 04:02:41,251 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/cf/da7735542b4e43258618f0c455194bb6 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/cf/da7735542b4e43258618f0c455194bb6 2023-09-14 04:02:41,254 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf/recovered.edits/9.seqid 2023-09-14 04:02:41,254 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb/recovered.edits/9.seqid 2023-09-14 04:02:41,255 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/79168faa51438ce0d37c106467bbedcf 2023-09-14 04:02:41,255 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testEmptyExportFileSystemState/96253ef581f979fdaee5fab371c8a7fb 2023-09-14 04:02:41,255 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-14 04:02:41,256 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-14 04:02:41,256 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-14 04:02:41,260 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230914a2a787278d164a7e8b9049054451b92f to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230914a2a787278d164a7e8b9049054451b92f 2023-09-14 04:02:41,261 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309147252a3c2cf244121a3cfb1d6a473eb31 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309147252a3c2cf244121a3cfb1d6a473eb31 2023-09-14 04:02:41,262 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-14 04:02:41,264 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,266 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-14 04:02:41,268 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-14 04:02:41,269 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,269 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-14 04:02:41,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664161269"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:41,269 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664161269"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:41,271 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 04:02:41,271 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 96253ef581f979fdaee5fab371c8a7fb, NAME => 'testtb-testEmptyExportFileSystemState,,1694664150135.96253ef581f979fdaee5fab371c8a7fb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 79168faa51438ce0d37c106467bbedcf, NAME => 'testtb-testEmptyExportFileSystemState,1,1694664150135.79168faa51438ce0d37c106467bbedcf.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 04:02:41,271 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-14 04:02:41,271 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694664161271"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:41,272 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-14 04:02:41,274 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-14 04:02:41,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 40 msec 2023-09-14 04:02:41,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-14 04:02:41,348 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-14 04:02:41,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-14 04:02:41,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:41,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-14 04:02:41,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-14 04:02:41,386 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 758) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:41496 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:33107 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:41318 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1098673857_1 at /127.0.0.1:45298 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:42507 from appattempt_1694664070168_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4607 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1098673857_1 at /127.0.0.1:41476 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:34637 from appattempt_1694664070168_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=924 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 243), ProcessCount=168 (was 168), AvailableMemoryMB=8473 (was 8562) 2023-09-14 04:02:41,386 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-14 04:02:41,408 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=924, MaxFileDescriptor=60000, SystemLoadAverage=197, ProcessCount=168, AvailableMemoryMB=8473 2023-09-14 04:02:41,408 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-14 04:02:41,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-14 04:02:41,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:41,413 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-14 04:02:41,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-14 04:02:41,414 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-14 04:02:41,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-14 04:02:41,416 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:41,416 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:41,417 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43 empty. 2023-09-14 04:02:41,417 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8 empty. 2023-09-14 04:02:41,417 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:41,417 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:41,418 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-14 04:02:41,427 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-14 04:02:41,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0d156db47175b1495b16a81e2eaeaa43, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:02:41,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9a8bea5b85a5f8528dda0b2b5592c1e8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp 2023-09-14 04:02:41,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:41,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 9a8bea5b85a5f8528dda0b2b5592c1e8, disabling compactions & flushes 2023-09-14 04:02:41,451 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:41,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:41,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. after waiting 0 ms 2023-09-14 04:02:41,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:41,451 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:41,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 9a8bea5b85a5f8528dda0b2b5592c1e8: 2023-09-14 04:02:41,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:41,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 0d156db47175b1495b16a81e2eaeaa43, disabling compactions & flushes 2023-09-14 04:02:41,453 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:41,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:41,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. after waiting 0 ms 2023-09-14 04:02:41,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:41,453 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:41,453 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 0d156db47175b1495b16a81e2eaeaa43: 2023-09-14 04:02:41,455 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-14 04:02:41,456 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664161456"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664161456"}]},"ts":"1694664161456"} 2023-09-14 04:02:41,456 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664161456"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664161456"}]},"ts":"1694664161456"} 2023-09-14 04:02:41,458 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-14 04:02:41,459 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-14 04:02:41,459 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664161459"}]},"ts":"1694664161459"} 2023-09-14 04:02:41,460 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-14 04:02:41,463 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-14 04:02:41,464 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-14 04:02:41,464 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-14 04:02:41,464 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-14 04:02:41,464 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-14 04:02:41,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d156db47175b1495b16a81e2eaeaa43, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a8bea5b85a5f8528dda0b2b5592c1e8, ASSIGN}] 2023-09-14 04:02:41,467 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a8bea5b85a5f8528dda0b2b5592c1e8, ASSIGN 2023-09-14 04:02:41,467 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d156db47175b1495b16a81e2eaeaa43, ASSIGN 2023-09-14 04:02:41,468 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d156db47175b1495b16a81e2eaeaa43, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34905,1694664063818; forceNewPlan=false, retain=false 2023-09-14 04:02:41,468 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a8bea5b85a5f8528dda0b2b5592c1e8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39305,1694664063904; forceNewPlan=false, retain=false 2023-09-14 04:02:41,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-14 04:02:41,618 INFO [jenkins-hbase4:45157] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-14 04:02:41,621 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0d156db47175b1495b16a81e2eaeaa43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:41,621 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9a8bea5b85a5f8528dda0b2b5592c1e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:41,621 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664161621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664161621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664161621"}]},"ts":"1694664161621"} 2023-09-14 04:02:41,621 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664161621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664161621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664161621"}]},"ts":"1694664161621"} 2023-09-14 04:02:41,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 0d156db47175b1495b16a81e2eaeaa43, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:02:41,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 9a8bea5b85a5f8528dda0b2b5592c1e8, server=jenkins-hbase4.apache.org,39305,1694664063904}] 2023-09-14 04:02:41,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-14 04:02:41,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:41,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d156db47175b1495b16a81e2eaeaa43, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.', STARTKEY => '', ENDKEY => '1'} 2023-09-14 04:02:41,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a8bea5b85a5f8528dda0b2b5592c1e8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.', STARTKEY => '1', ENDKEY => ''} 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. service=AccessControlService 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. service=AccessControlService 2023-09-14 04:02:41,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:02:41,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:41,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:41,780 INFO [StoreOpener-0d156db47175b1495b16a81e2eaeaa43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:41,780 INFO [StoreOpener-9a8bea5b85a5f8528dda0b2b5592c1e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:41,781 DEBUG [StoreOpener-0d156db47175b1495b16a81e2eaeaa43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/cf 2023-09-14 04:02:41,781 DEBUG [StoreOpener-9a8bea5b85a5f8528dda0b2b5592c1e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/cf 2023-09-14 04:02:41,782 DEBUG [StoreOpener-9a8bea5b85a5f8528dda0b2b5592c1e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/cf 2023-09-14 04:02:41,781 DEBUG [StoreOpener-0d156db47175b1495b16a81e2eaeaa43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/cf 2023-09-14 04:02:41,782 INFO [StoreOpener-9a8bea5b85a5f8528dda0b2b5592c1e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a8bea5b85a5f8528dda0b2b5592c1e8 columnFamilyName cf 2023-09-14 04:02:41,782 INFO [StoreOpener-0d156db47175b1495b16a81e2eaeaa43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d156db47175b1495b16a81e2eaeaa43 columnFamilyName cf 2023-09-14 04:02:41,783 INFO [StoreOpener-0d156db47175b1495b16a81e2eaeaa43-1] regionserver.HStore(310): Store=0d156db47175b1495b16a81e2eaeaa43/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:02:41,783 INFO [StoreOpener-9a8bea5b85a5f8528dda0b2b5592c1e8-1] regionserver.HStore(310): Store=9a8bea5b85a5f8528dda0b2b5592c1e8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-14 04:02:41,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:41,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:41,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:41,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:41,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:41,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:41,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:02:41,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-14 04:02:41,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9a8bea5b85a5f8528dda0b2b5592c1e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66114414, jitterRate=-0.014818459749221802}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:02:41,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9a8bea5b85a5f8528dda0b2b5592c1e8: 2023-09-14 04:02:41,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d156db47175b1495b16a81e2eaeaa43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71258916, jitterRate=0.061840593814849854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-14 04:02:41,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d156db47175b1495b16a81e2eaeaa43: 2023-09-14 04:02:41,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43., pid=108, masterSystemTime=1694664161775 2023-09-14 04:02:41,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8., pid=109, masterSystemTime=1694664161775 2023-09-14 04:02:41,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:41,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:41,791 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=0d156db47175b1495b16a81e2eaeaa43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:41,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:41,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:41,791 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664161791"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664161791"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664161791"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664161791"}]},"ts":"1694664161791"} 2023-09-14 04:02:41,792 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9a8bea5b85a5f8528dda0b2b5592c1e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:41,792 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664161792"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694664161792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694664161792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694664161792"}]},"ts":"1694664161792"} 2023-09-14 04:02:41,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-14 04:02:41,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 0d156db47175b1495b16a81e2eaeaa43, server=jenkins-hbase4.apache.org,34905,1694664063818 in 170 msec 2023-09-14 04:02:41,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-14 04:02:41,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 9a8bea5b85a5f8528dda0b2b5592c1e8, server=jenkins-hbase4.apache.org,39305,1694664063904 in 170 msec 2023-09-14 04:02:41,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d156db47175b1495b16a81e2eaeaa43, ASSIGN in 329 msec 2023-09-14 04:02:41,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-14 04:02:41,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a8bea5b85a5f8528dda0b2b5592c1e8, ASSIGN in 330 msec 2023-09-14 04:02:41,797 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-14 04:02:41,797 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664161797"}]},"ts":"1694664161797"} 2023-09-14 04:02:41,798 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-14 04:02:41,800 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-14 04:02:41,800 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-14 04:02:41,802 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-14 04:02:41,803 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:41,803 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:41,803 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:41,803 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:41,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:41,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:41,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:41,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-14 04:02:41,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 395 msec 2023-09-14 04:02:42,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-14 04:02:42,019 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-14 04:02:42,021 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,021 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:42,023 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:02:42,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 04:02:42,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664162033 (current time:1694664162033). 2023-09-14 04:02:42,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:02:42,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x0abb0064 to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:42,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4560dda3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:42,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:42,044 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:42,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0abb0064 to 127.0.0.1:64527 2023-09-14 04:02:42,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:42,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x0171241a to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:42,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@531bac70, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:42,052 DEBUG [hconnection-0x1055ee75-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:42,055 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:42,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:42,060 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:42,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0171241a to 127.0.0.1:64527 2023-09-14 04:02:42,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:42,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-14 04:02:42,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:02:42,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 04:02:42,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 04:02:42,065 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 04:02:42,065 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694664762065 2023-09-14 04:02:42,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 04:02:42,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,067 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:02:42,067 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:02:42,068 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 04:02:42,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 04:02:42,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-14 04:02:42,069 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 04:02:42,070 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694664762070 2023-09-14 04:02:42,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,077 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-14 04:02:42,077 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:42,079 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-14 04:02:42,079 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-14 04:02:42,079 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,079 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,080 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,080 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,080 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,080 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,081 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,081 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,081 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,081 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:02:42,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,082 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 04:02:42,082 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 04:02:42,082 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:42,082 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,082 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:42,082 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 04:02:42,083 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 04:02:42,083 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 04:02:42,083 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:42,083 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 04:02:42,084 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 04:02:42,084 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 04:02:42,084 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 04:02:42,083 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 04:02:42,084 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 04:02:42,084 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 04:02:42,094 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,094 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,095 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,095 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:42,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,096 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,096 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-14 04:02:42,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d02d8ec[Count = 1] remaining members to acquire global barrier 2023-09-14 04:02:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-14 04:02:42,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d02d8ec[Count = 0] remaining members to acquire global barrier 2023-09-14 04:02:42,099 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-14 04:02:42,099 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 04:02:42,100 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 04:02:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 04:02:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 04:02:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:42,101 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,101 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:02:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:42,101 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:42,100 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:02:42,100 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:42,101 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:42,101 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. started... 2023-09-14 04:02:42,101 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. started... 2023-09-14 04:02:42,102 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d156db47175b1495b16a81e2eaeaa43: 2023-09-14 04:02:42,102 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a8bea5b85a5f8528dda0b2b5592c1e8: 2023-09-14 04:02:42,102 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,102 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,102 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:42,102 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:42,102 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:02:42,102 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-14 04:02:42,104 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 04:02:42,104 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:42,104 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 04:02:42,115 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. completed. 2023-09-14 04:02:42,115 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:42,115 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. completed. 2023-09-14 04:02:42,115 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:42,115 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:42,116 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:42,115 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:42,116 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:42,116 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,116 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,116 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 04:02:42,116 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 04:02:42,116 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:02:42,116 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:02:42,117 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 04:02:42,118 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,118 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 04:02:42,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,118 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,118 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:42,118 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 04:02:42,118 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:42,119 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 04:02:42,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:02:42,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-14 04:02:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39305,1694664063904': 2023-09-14 04:02:42,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-14 04:02:42,126 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-14 04:02:42,126 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:02:42,126 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:02:42,127 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,127 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:02:42,128 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,128 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,128 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,128 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,128 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,129 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,129 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,128 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,129 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,130 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,131 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,132 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,132 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,135 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,135 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,135 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,135 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:42,135 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,135 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,135 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,135 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,135 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,137 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,137 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:02:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,137 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,137 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,138 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-14 04:02:42,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-14 04:02:42,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,163 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694664162066Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694664162146 (+80 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694664162146Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694664162146Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694664162150 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694664162156 (+6 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694664162162 (+6 ms) 2023-09-14 04:02:42,165 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 04:02:42,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 99 msec 2023-09-14 04:02:42,167 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:42,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-14 04:02:42,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:02:42,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34905] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:02:42,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39305] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-14 04:02:42,173 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,174 DEBUG [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:42,174 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-14 04:02:42,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 04:02:42,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694664162183 (current time:1694664162183). 2023-09-14 04:02:42,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-14 04:02:42,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x1c8dcc5d to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:42,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2394afff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:42,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:42,192 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:42,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c8dcc5d to 127.0.0.1:64527 2023-09-14 04:02:42,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:42,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(139): Connect 0x66bdb4da to 127.0.0.1:64527 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-14 04:02:42,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14206374, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-14 04:02:42,200 DEBUG [hconnection-0x124dcd58-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:42,207 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:42,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-14 04:02:42,213 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-14 04:02:42,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66bdb4da to 127.0.0.1:64527 2023-09-14 04:02:42,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:02:42,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-14 04:02:42,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-14 04:02:42,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 04:02:42,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 04:02:42,218 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 04:02:42,219 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694664762219 2023-09-14 04:02:42,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-14 04:02:42,220 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-14 04:02:42,220 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-14 04:02:42,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 04:02:42,221 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-14 04:02:42,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-09-14 04:02:42,223 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 04:02:42,224 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694664762224 2023-09-14 04:02:42,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,232 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-14 04:02:42,232 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:42,233 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-14 04:02:42,233 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-14 04:02:42,234 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,234 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,236 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,236 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,236 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,236 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,236 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,236 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,237 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,237 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-14 04:02:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,238 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 04:02:42,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,238 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-14 04:02:42,238 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 04:02:42,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,238 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:42,238 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 04:02:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 04:02:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 04:02:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 04:02:42,239 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:42,239 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-14 04:02:42,240 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-14 04:02:42,240 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 04:02:42,241 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 04:02:42,241 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-14 04:02:42,241 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-14 04:02:42,241 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 04:02:42,241 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39261,1694664063868' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-14 04:02:42,242 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,242 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,244 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,244 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,244 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,244 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,245 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:42,244 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,245 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:42,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,245 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,245 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-14 04:02:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34905,1694664063818' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-14 04:02:42,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18e95e6d[Count = 1] remaining members to acquire global barrier 2023-09-14 04:02:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39305,1694664063904' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-14 04:02:42,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18e95e6d[Count = 0] remaining members to acquire global barrier 2023-09-14 04:02:42,249 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-14 04:02:42,249 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 04:02:42,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,255 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:42,255 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 04:02:42,255 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-14 04:02:42,256 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 04:02:42,255 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:42,255 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:42,256 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. started... 2023-09-14 04:02:42,256 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39261,1694664063868' in zk 2023-09-14 04:02:42,256 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,256 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-14 04:02:42,256 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-14 04:02:42,256 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0d156db47175b1495b16a81e2eaeaa43 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-14 04:02:42,256 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:42,256 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-14 04:02:42,256 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. started... 2023-09-14 04:02:42,256 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9a8bea5b85a5f8528dda0b2b5592c1e8 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-14 04:02:42,257 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 04:02:42,257 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:42,257 DEBUG [member: 'jenkins-hbase4.apache.org,39261,1694664063868' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 04:02:42,277 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230914fccc259631524305863c8e8f6081320f to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914fccc259631524305863c8e8f6081320f 2023-09-14 04:02:42,277 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230914cd19a5e094984835a65b31b354bd0bc8 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cd19a5e094984835a65b31b354bd0bc8 2023-09-14 04:02:42,287 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/.tmp/cf/42f121da92f044afa51a611cb52acbd5 2023-09-14 04:02:42,289 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/.tmp/cf/b95f5b3048b5487f8d4b018fc0c2d44a 2023-09-14 04:02:42,293 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/.tmp/cf/42f121da92f044afa51a611cb52acbd5 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/cf/42f121da92f044afa51a611cb52acbd5 2023-09-14 04:02:42,293 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/.tmp/cf/b95f5b3048b5487f8d4b018fc0c2d44a as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/cf/b95f5b3048b5487f8d4b018fc0c2d44a 2023-09-14 04:02:42,297 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/cf/42f121da92f044afa51a611cb52acbd5, entries=45, sequenceid=6, filesize=13.0 K 2023-09-14 04:02:42,297 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/cf/b95f5b3048b5487f8d4b018fc0c2d44a, entries=5, sequenceid=6, filesize=5.8 K 2023-09-14 04:02:42,298 INFO [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 9a8bea5b85a5f8528dda0b2b5592c1e8 in 42ms, sequenceid=6, compaction requested=false 2023-09-14 04:02:42,298 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-14 04:02:42,298 INFO [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 0d156db47175b1495b16a81e2eaeaa43 in 42ms, sequenceid=6, compaction requested=false 2023-09-14 04:02:42,298 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d156db47175b1495b16a81e2eaeaa43: 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a8bea5b85a5f8528dda0b2b5592c1e8: 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/cf/b95f5b3048b5487f8d4b018fc0c2d44a] hfiles 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/cf/42f121da92f044afa51a611cb52acbd5] hfiles 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/cf/b95f5b3048b5487f8d4b018fc0c2d44a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,301 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/cf/42f121da92f044afa51a611cb52acbd5 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,308 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. completed. 2023-09-14 04:02:42,308 DEBUG [rs(jenkins-hbase4.apache.org,34905,1694664063818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:42,308 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:42,308 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:42,308 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. completed. 2023-09-14 04:02:42,308 DEBUG [rs(jenkins-hbase4.apache.org,39305,1694664063904)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:42,308 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,308 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-14 04:02:42,308 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-14 04:02:42,308 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,308 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 04:02:42,308 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-14 04:02:42,308 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34905,1694664063818' in zk 2023-09-14 04:02:42,309 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39305,1694664063904' in zk 2023-09-14 04:02:42,310 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,310 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 04:02:42,310 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-14 04:02:42,310 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:42,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,310 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,310 DEBUG [member: 'jenkins-hbase4.apache.org,39305,1694664063904' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 04:02:42,310 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:42,312 DEBUG [member: 'jenkins-hbase4.apache.org,34905,1694664063818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-14 04:02:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39305,1694664063904': 2023-09-14 04:02:42,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39305,1694664063904' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-14 04:02:42,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34905,1694664063818': 2023-09-14 04:02:42,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34905,1694664063818' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-14 04:02:42,319 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-14 04:02:42,319 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-14 04:02:42,319 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-14 04:02:42,319 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,319 INFO [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-14 04:02:42,320 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:42,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-14 04:02:42,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-14 04:02:42,321 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-14 04:02:42,323 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,323 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,323 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,323 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-14 04:02:42,324 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,323 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,323 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,324 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,324 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,325 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-14 04:02:42,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,326 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-14 04:02:42,327 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,327 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,329 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,329 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,329 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,329 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,330 DEBUG [(jenkins-hbase4.apache.org,45157,1694664062520)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-14 04:02:42,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-14 04:02:42,331 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-14 04:02:42,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-14 04:02:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-14 04:02:42,331 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-14 04:02:42,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,331 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:02:42,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:42,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-14 04:02:42,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:42,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-14 04:02:42,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914fccc259631524305863c8e8f6081320f, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cd19a5e094984835a65b31b354bd0bc8] mob files 2023-09-14 04:02:42,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914fccc259631524305863c8e8f6081320f 2023-09-14 04:02:42,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cd19a5e094984835a65b31b354bd0bc8 2023-09-14 04:02:42,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,339 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-14 04:02:42,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,356 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694664162219Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694664162338 (+119 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694664162338Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694664162338Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694664162341 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694664162349 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694664162356 (+7 ms) 2023-09-14 04:02:42,359 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-14 04:02:42,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 139 msec 2023-09-14 04:02:42,521 DEBUG [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-14 04:02:42,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-14 04:02:42,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-14 04:02:42,523 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523 2023-09-14 04:02:42,523 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43181, tgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523, rawTgtDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523, srcFsUri=hdfs://localhost:43181, srcDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:02:42,544 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33 2023-09-14 04:02:42,544 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1667086025_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,545 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43181, inputRoot=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33, snapshotDir=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-14 04:02:42,559 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:42,578 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:42,578 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:42,579 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:42,579 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:43,446 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-6465519227148203799.jar 2023-09-14 04:02:43,446 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:43,447 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:43,512 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/hadoop-6694209085121753577.jar 2023-09-14 04:02:43,513 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:43,513 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:43,514 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:43,514 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:43,514 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:43,515 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-14 04:02:43,515 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-14 04:02:43,515 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-14 04:02:43,516 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-14 04:02:43,516 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-14 04:02:43,516 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-14 04:02:43,517 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-14 04:02:43,517 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-14 04:02:43,517 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-14 04:02:43,518 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-14 04:02:43,518 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-14 04:02:43,519 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:43,519 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:43,520 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:02:43,520 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:43,520 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-14 04:02:43,521 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:02:43,521 DEBUG [Listener at jenkins-hbase4.apache.org/37059] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-14 04:02:43,847 WARN [Listener at jenkins-hbase4.apache.org/37059] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-14 04:02:43,849 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-14 04:02:43,851 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-14 04:02:45,363 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:02:45,363 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-14 04:02:45,366 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0006_000001 (auth:SIMPLE) 2023-09-14 04:02:45,741 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0007_000001 (auth:SIMPLE) 2023-09-14 04:02:46,683 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 04:02:49,441 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0007_000001 (auth:SIMPLE) 2023-09-14 04:02:51,647 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0007_000001 (auth:SIMPLE) 2023-09-14 04:02:54,232 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0007_000001 (auth:SIMPLE) 2023-09-14 04:02:55,995 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-14 04:02:55,995 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-14 04:02:56,006 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,006 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-14 04:02:56,006 INFO [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-14 04:02:56,007 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,007 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-14 04:02:56,007 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-14 04:02:56,007 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1421678195_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,008 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-14 04:02:56,008 DEBUG [Listener at jenkins-hbase4.apache.org/37059] snapshot.TestExportSnapshot(367): hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/export-test/export-1694664162523/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-14 04:02:56,013 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-14 04:02:56,018 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664176018"}]},"ts":"1694664176018"} 2023-09-14 04:02:56,019 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-14 04:02:56,020 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-14 04:02:56,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d156db47175b1495b16a81e2eaeaa43, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a8bea5b85a5f8528dda0b2b5592c1e8, UNASSIGN}] 2023-09-14 04:02:56,022 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d156db47175b1495b16a81e2eaeaa43, UNASSIGN 2023-09-14 04:02:56,023 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a8bea5b85a5f8528dda0b2b5592c1e8, UNASSIGN 2023-09-14 04:02:56,023 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=0d156db47175b1495b16a81e2eaeaa43, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:02:56,023 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9a8bea5b85a5f8528dda0b2b5592c1e8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:02:56,023 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664176023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664176023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664176023"}]},"ts":"1694664176023"} 2023-09-14 04:02:56,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664176023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694664176023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694664176023"}]},"ts":"1694664176023"} 2023-09-14 04:02:56,024 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 0d156db47175b1495b16a81e2eaeaa43, server=jenkins-hbase4.apache.org,34905,1694664063818}] 2023-09-14 04:02:56,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 9a8bea5b85a5f8528dda0b2b5592c1e8, server=jenkins-hbase4.apache.org,39305,1694664063904}] 2023-09-14 04:02:56,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-14 04:02:56,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:56,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:56,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d156db47175b1495b16a81e2eaeaa43, disabling compactions & flushes 2023-09-14 04:02:56,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9a8bea5b85a5f8528dda0b2b5592c1e8, disabling compactions & flushes 2023-09-14 04:02:56,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:56,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:56,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:56,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:56,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. after waiting 0 ms 2023-09-14 04:02:56,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:56,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. after waiting 0 ms 2023-09-14 04:02:56,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:56,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:02:56,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:02:56,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:56,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:02:56,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8. 2023-09-14 04:02:56,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43. 2023-09-14 04:02:56,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9a8bea5b85a5f8528dda0b2b5592c1e8: 2023-09-14 04:02:56,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d156db47175b1495b16a81e2eaeaa43: 2023-09-14 04:02:56,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:56,191 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9a8bea5b85a5f8528dda0b2b5592c1e8, regionState=CLOSED 2023-09-14 04:02:56,191 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664176191"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664176191"}]},"ts":"1694664176191"} 2023-09-14 04:02:56,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:56,192 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=0d156db47175b1495b16a81e2eaeaa43, regionState=CLOSED 2023-09-14 04:02:56,192 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694664176192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694664176192"}]},"ts":"1694664176192"} 2023-09-14 04:02:56,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-14 04:02:56,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 9a8bea5b85a5f8528dda0b2b5592c1e8, server=jenkins-hbase4.apache.org,39305,1694664063904 in 168 msec 2023-09-14 04:02:56,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-14 04:02:56,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 0d156db47175b1495b16a81e2eaeaa43, server=jenkins-hbase4.apache.org,34905,1694664063818 in 169 msec 2023-09-14 04:02:56,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9a8bea5b85a5f8528dda0b2b5592c1e8, UNASSIGN in 173 msec 2023-09-14 04:02:56,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-14 04:02:56,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d156db47175b1495b16a81e2eaeaa43, UNASSIGN in 174 msec 2023-09-14 04:02:56,197 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694664176197"}]},"ts":"1694664176197"} 2023-09-14 04:02:56,198 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-14 04:02:56,200 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-14 04:02:56,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 186 msec 2023-09-14 04:02:56,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-14 04:02:56,319 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-14 04:02:56,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,323 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,324 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,325 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39305] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,328 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:56,328 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:56,330 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/recovered.edits] 2023-09-14 04:02:56,330 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/cf, FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/recovered.edits] 2023-09-14 04:02:56,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,330 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-14 04:02:56,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-14 04:02:56,331 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-14 04:02:56,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:56,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:56,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:56,332 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-09-14 04:02:56,332 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-14 04:02:56,332 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-14 04:02:56,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-14 04:02:56,335 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/cf/b95f5b3048b5487f8d4b018fc0c2d44a to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/cf/b95f5b3048b5487f8d4b018fc0c2d44a 2023-09-14 04:02:56,335 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/cf/42f121da92f044afa51a611cb52acbd5 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/cf/42f121da92f044afa51a611cb52acbd5 2023-09-14 04:02:56,338 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43/recovered.edits/9.seqid 2023-09-14 04:02:56,338 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/recovered.edits/9.seqid to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8/recovered.edits/9.seqid 2023-09-14 04:02:56,339 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d156db47175b1495b16a81e2eaeaa43 2023-09-14 04:02:56,339 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9a8bea5b85a5f8528dda0b2b5592c1e8 2023-09-14 04:02:56,339 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-14 04:02:56,339 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-14 04:02:56,340 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-14 04:02:56,343 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914fccc259631524305863c8e8f6081320f to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230914fccc259631524305863c8e8f6081320f 2023-09-14 04:02:56,344 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cd19a5e094984835a65b31b354bd0bc8 to hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230914cd19a5e094984835a65b31b354bd0bc8 2023-09-14 04:02:56,345 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-14 04:02:56,347 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,349 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-14 04:02:56,351 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-14 04:02:56,353 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,353 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-14 04:02:56,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664176353"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:56,353 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694664176353"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:56,355 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-14 04:02:56,355 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0d156db47175b1495b16a81e2eaeaa43, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694664161410.0d156db47175b1495b16a81e2eaeaa43.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9a8bea5b85a5f8528dda0b2b5592c1e8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694664161410.9a8bea5b85a5f8528dda0b2b5592c1e8.', STARTKEY => '1', ENDKEY => ''}] 2023-09-14 04:02:56,355 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-14 04:02:56,355 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694664176355"}]},"ts":"9223372036854775807"} 2023-09-14 04:02:56,357 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-14 04:02:56,358 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,360 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 38 msec 2023-09-14 04:02:56,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-14 04:02:56,435 INFO [Listener at jenkins-hbase4.apache.org/37059] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-14 04:02:56,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-14 04:02:56,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-14 04:02:56,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45157] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-14 04:02:56,473 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 763) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:57808 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1988502388) connection to jenkins-hbase4.apache.org/172.31.14.131:33765 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Parameter Sending Thread #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:46924 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5213 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1421678195_17 at /127.0.0.1:54828 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x61de7c9e-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2106478391_1 at /127.0.0.1:59120 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 924), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=161 (was 197), ProcessCount=168 (was 168), AvailableMemoryMB=8399 (was 8473) 2023-09-14 04:02:56,473 WARN [Listener at jenkins-hbase4.apache.org/37059] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-14 04:02:56,473 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-14 04:02:56,488 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-14 04:03:00,405 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694664070168_0007_000001 (auth:SIMPLE) 2023-09-14 04:03:01,753 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-14 04:03:10,615 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-14 04:03:24,730 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-14 04:03:24,730 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-14 04:03:24,838 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-14 04:03:24,849 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-14 04:03:24,850 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-14 04:03:24,858 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-14 04:03:24,961 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-14 04:03:24,962 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-14 04:03:24,962 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-14 04:03:24,962 INFO [Listener at jenkins-hbase4.apache.org/37059] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-14 04:03:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/37059] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x198b16b9 to 127.0.0.1:64527 2023-09-14 04:03:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/37059] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:03:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/37059] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-14 04:03:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/37059] util.JVMClusterUtil(257): Found active master hash=1088740201, stopped=false 2023-09-14 04:03:24,962 DEBUG [Listener at jenkins-hbase4.apache.org/37059] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:03:24,963 DEBUG [Listener at jenkins-hbase4.apache.org/37059] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-14 04:03:24,963 INFO [Listener at jenkins-hbase4.apache.org/37059] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:03:24,965 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-14 04:03:24,965 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-14 04:03:24,965 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:03:24,965 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-14 04:03:24,965 INFO [Listener at jenkins-hbase4.apache.org/37059] procedure2.ProcedureExecutor(628): Stopping 2023-09-14 04:03:24,965 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-14 04:03:24,965 DEBUG [Listener at jenkins-hbase4.apache.org/37059] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ade707b to 127.0.0.1:64527 2023-09-14 04:03:24,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 04:03:24,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 04:03:24,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 04:03:24,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-14 04:03:24,965 DEBUG [Listener at jenkins-hbase4.apache.org/37059] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:03:24,966 INFO [Listener at jenkins-hbase4.apache.org/37059] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34905,1694664063818' ***** 2023-09-14 04:03:24,966 DEBUG [Listener at jenkins-hbase4.apache.org/37059] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:03:24,966 INFO [Listener at jenkins-hbase4.apache.org/37059] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-14 04:03:24,966 INFO [Listener at jenkins-hbase4.apache.org/37059] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39261,1694664063868' ***** 2023-09-14 04:03:24,966 DEBUG [Listener at jenkins-hbase4.apache.org/37059] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:03:24,966 INFO [RS:0;jenkins-hbase4:34905] regionserver.HeapMemoryManager(220): Stopping 2023-09-14 04:03:24,966 INFO [Listener at jenkins-hbase4.apache.org/37059] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-14 04:03:24,966 INFO [Listener at jenkins-hbase4.apache.org/37059] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39305,1694664063904' ***** 2023-09-14 04:03:24,966 INFO [RS:0;jenkins-hbase4:34905] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-14 04:03:24,966 DEBUG [Listener at jenkins-hbase4.apache.org/37059] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:03:24,966 INFO [RS:0;jenkins-hbase4:34905] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-14 04:03:24,966 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-14 04:03:24,967 INFO [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:03:24,966 INFO [RS:1;jenkins-hbase4:39261] regionserver.HeapMemoryManager(220): Stopping 2023-09-14 04:03:24,967 DEBUG [RS:0;jenkins-hbase4:34905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x048344f7 to 127.0.0.1:64527 2023-09-14 04:03:24,967 INFO [Listener at jenkins-hbase4.apache.org/37059] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-14 04:03:24,967 DEBUG [RS:0;jenkins-hbase4:34905] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:03:24,967 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-14 04:03:24,969 INFO [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34905,1694664063818; all regions closed. 2023-09-14 04:03:24,967 INFO [RS:1;jenkins-hbase4:39261] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-14 04:03:24,969 INFO [RS:2;jenkins-hbase4:39305] regionserver.HeapMemoryManager(220): Stopping 2023-09-14 04:03:24,970 INFO [RS:1;jenkins-hbase4:39261] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-14 04:03:24,970 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-14 04:03:24,970 INFO [RS:2;jenkins-hbase4:39305] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-14 04:03:24,970 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:03:24,970 INFO [RS:2;jenkins-hbase4:39305] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-14 04:03:24,970 DEBUG [RS:1;jenkins-hbase4:39261] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13f3c187 to 127.0.0.1:64527 2023-09-14 04:03:24,970 DEBUG [RS:1;jenkins-hbase4:39261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:03:24,971 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(3305): Received CLOSE for ae125d1557f9e81696148917eee0f932 2023-09-14 04:03:24,971 INFO [RS:1;jenkins-hbase4:39261] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-14 04:03:24,971 INFO [RS:1;jenkins-hbase4:39261] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-14 04:03:24,971 INFO [RS:1;jenkins-hbase4:39261] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-14 04:03:24,971 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-14 04:03:24,971 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(3305): Received CLOSE for e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:03:24,971 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:03:24,971 DEBUG [RS:2;jenkins-hbase4:39305] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7de28631 to 127.0.0.1:64527 2023-09-14 04:03:24,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ae125d1557f9e81696148917eee0f932, disabling compactions & flushes 2023-09-14 04:03:24,972 DEBUG [RS:2;jenkins-hbase4:39305] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:03:24,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:03:24,972 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-14 04:03:24,972 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-14 04:03:24,972 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1478): Online Regions={ae125d1557f9e81696148917eee0f932=hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932., e456812d7bb6ae4e34aa5d52586de321=hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321.} 2023-09-14 04:03:24,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:03:24,973 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-14 04:03:24,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-14 04:03:24,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. after waiting 0 ms 2023-09-14 04:03:24,973 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-14 04:03:24,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:03:24,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-14 04:03:24,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-14 04:03:24,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-14 04:03:24,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ae125d1557f9e81696148917eee0f932 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-14 04:03:24,973 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-14 04:03:24,974 DEBUG [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1504): Waiting on ae125d1557f9e81696148917eee0f932, e456812d7bb6ae4e34aa5d52586de321 2023-09-14 04:03:24,974 DEBUG [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-14 04:03:24,987 DEBUG [RS:0;jenkins-hbase4:34905] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/oldWALs 2023-09-14 04:03:24,987 INFO [RS:0;jenkins-hbase4:34905] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34905%2C1694664063818:(num 1694664065571) 2023-09-14 04:03:24,987 DEBUG [RS:0;jenkins-hbase4:34905] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:03:24,988 INFO [RS:0;jenkins-hbase4:34905] regionserver.LeaseManager(133): Closed leases 2023-09-14 04:03:24,988 INFO [RS:0;jenkins-hbase4:34905] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-14 04:03:24,997 INFO [RS:0;jenkins-hbase4:34905] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-14 04:03:24,997 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-14 04:03:24,997 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/.tmp/info/ab80e5f193104860bdfa324b14dc6b26 2023-09-14 04:03:24,997 INFO [RS:0;jenkins-hbase4:34905] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-14 04:03:24,997 INFO [RS:0;jenkins-hbase4:34905] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-14 04:03:24,998 INFO [RS:0;jenkins-hbase4:34905] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34905 2023-09-14 04:03:25,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932/.tmp/l/62f90a5f5e6245de96f0a79c6027c93d 2023-09-14 04:03:25,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab80e5f193104860bdfa324b14dc6b26 2023-09-14 04:03:25,005 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:03:25,005 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:03:25,005 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 04:03:25,005 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 04:03:25,005 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 04:03:25,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 62f90a5f5e6245de96f0a79c6027c93d 2023-09-14 04:03:25,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932/.tmp/l/62f90a5f5e6245de96f0a79c6027c93d as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932/l/62f90a5f5e6245de96f0a79c6027c93d 2023-09-14 04:03:25,007 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34905,1694664063818] 2023-09-14 04:03:25,008 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34905,1694664063818 2023-09-14 04:03:25,008 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34905,1694664063818; numProcessing=1 2023-09-14 04:03:25,008 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 04:03:25,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 62f90a5f5e6245de96f0a79c6027c93d 2023-09-14 04:03:25,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932/l/62f90a5f5e6245de96f0a79c6027c93d, entries=7, sequenceid=18, filesize=5.2 K 2023-09-14 04:03:25,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ae125d1557f9e81696148917eee0f932 in 41ms, sequenceid=18, compaction requested=false 2023-09-14 04:03:25,019 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/.tmp/rep_barrier/13432bcf56a14fd79b8659cd1018ca5b 2023-09-14 04:03:25,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/acl/ae125d1557f9e81696148917eee0f932/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-14 04:03:25,020 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:03:25,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:03:25,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ae125d1557f9e81696148917eee0f932: 2023-09-14 04:03:25,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694664066771.ae125d1557f9e81696148917eee0f932. 2023-09-14 04:03:25,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e456812d7bb6ae4e34aa5d52586de321, disabling compactions & flushes 2023-09-14 04:03:25,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:03:25,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:03:25,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. after waiting 0 ms 2023-09-14 04:03:25,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:03:25,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e456812d7bb6ae4e34aa5d52586de321 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-14 04:03:25,024 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13432bcf56a14fd79b8659cd1018ca5b 2023-09-14 04:03:25,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321/.tmp/info/c01f9329cf2f41268278e2955ec92302 2023-09-14 04:03:25,034 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/.tmp/table/d159a2337aaf4eb2bd389e8d9bf9b5f8 2023-09-14 04:03:25,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321/.tmp/info/c01f9329cf2f41268278e2955ec92302 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321/info/c01f9329cf2f41268278e2955ec92302 2023-09-14 04:03:25,038 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d159a2337aaf4eb2bd389e8d9bf9b5f8 2023-09-14 04:03:25,038 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/.tmp/info/ab80e5f193104860bdfa324b14dc6b26 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/info/ab80e5f193104860bdfa324b14dc6b26 2023-09-14 04:03:25,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321/info/c01f9329cf2f41268278e2955ec92302, entries=2, sequenceid=6, filesize=4.8 K 2023-09-14 04:03:25,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e456812d7bb6ae4e34aa5d52586de321 in 19ms, sequenceid=6, compaction requested=false 2023-09-14 04:03:25,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab80e5f193104860bdfa324b14dc6b26 2023-09-14 04:03:25,045 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/info/ab80e5f193104860bdfa324b14dc6b26, entries=48, sequenceid=131, filesize=10.3 K 2023-09-14 04:03:25,046 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/.tmp/rep_barrier/13432bcf56a14fd79b8659cd1018ca5b as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/rep_barrier/13432bcf56a14fd79b8659cd1018ca5b 2023-09-14 04:03:25,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/namespace/e456812d7bb6ae4e34aa5d52586de321/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-14 04:03:25,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:03:25,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:03:25,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e456812d7bb6ae4e34aa5d52586de321: 2023-09-14 04:03:25,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694664066035.e456812d7bb6ae4e34aa5d52586de321. 2023-09-14 04:03:25,050 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-14 04:03:25,050 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-14 04:03:25,050 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-14 04:03:25,051 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13432bcf56a14fd79b8659cd1018ca5b 2023-09-14 04:03:25,051 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/rep_barrier/13432bcf56a14fd79b8659cd1018ca5b, entries=13, sequenceid=131, filesize=6.4 K 2023-09-14 04:03:25,052 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/.tmp/table/d159a2337aaf4eb2bd389e8d9bf9b5f8 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/table/d159a2337aaf4eb2bd389e8d9bf9b5f8 2023-09-14 04:03:25,056 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d159a2337aaf4eb2bd389e8d9bf9b5f8 2023-09-14 04:03:25,056 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/table/d159a2337aaf4eb2bd389e8d9bf9b5f8, entries=24, sequenceid=131, filesize=6.9 K 2023-09-14 04:03:25,057 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 84ms, sequenceid=131, compaction requested=false 2023-09-14 04:03:25,066 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-14 04:03:25,067 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-14 04:03:25,067 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-14 04:03:25,067 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-14 04:03:25,067 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-14 04:03:25,067 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-14 04:03:25,108 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 04:03:25,109 INFO [RS:0;jenkins-hbase4:34905] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34905,1694664063818; zookeeper connection closed. 2023-09-14 04:03:25,109 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:34905-0x100a898aa680001, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 04:03:25,109 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@14e4693f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@14e4693f 2023-09-14 04:03:25,111 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34905,1694664063818 already deleted, retry=false 2023-09-14 04:03:25,111 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34905,1694664063818 expired; onlineServers=2 2023-09-14 04:03:25,174 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39305,1694664063904; all regions closed. 2023-09-14 04:03:25,174 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39261,1694664063868; all regions closed. 2023-09-14 04:03:25,182 DEBUG [RS:1;jenkins-hbase4:39261] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/oldWALs 2023-09-14 04:03:25,182 DEBUG [RS:2;jenkins-hbase4:39305] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/oldWALs 2023-09-14 04:03:25,182 INFO [RS:2;jenkins-hbase4:39305] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39305%2C1694664063904:(num 1694664065571) 2023-09-14 04:03:25,182 INFO [RS:1;jenkins-hbase4:39261] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39261%2C1694664063868.meta:.meta(num 1694664065722) 2023-09-14 04:03:25,182 DEBUG [RS:2;jenkins-hbase4:39305] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:03:25,182 INFO [RS:2;jenkins-hbase4:39305] regionserver.LeaseManager(133): Closed leases 2023-09-14 04:03:25,182 INFO [RS:2;jenkins-hbase4:39305] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-14 04:03:25,183 INFO [RS:2;jenkins-hbase4:39305] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-14 04:03:25,183 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-14 04:03:25,183 INFO [RS:2;jenkins-hbase4:39305] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-14 04:03:25,183 INFO [RS:2;jenkins-hbase4:39305] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-14 04:03:25,184 INFO [RS:2;jenkins-hbase4:39305] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39305 2023-09-14 04:03:25,188 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:03:25,188 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 04:03:25,188 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39305,1694664063904 2023-09-14 04:03:25,188 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39305,1694664063904] 2023-09-14 04:03:25,188 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39305,1694664063904; numProcessing=2 2023-09-14 04:03:25,189 DEBUG [RS:1;jenkins-hbase4:39261] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/oldWALs 2023-09-14 04:03:25,190 INFO [RS:1;jenkins-hbase4:39261] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39261%2C1694664063868:(num 1694664065571) 2023-09-14 04:03:25,190 DEBUG [RS:1;jenkins-hbase4:39261] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:03:25,190 INFO [RS:1;jenkins-hbase4:39261] regionserver.LeaseManager(133): Closed leases 2023-09-14 04:03:25,190 INFO [RS:1;jenkins-hbase4:39261] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-14 04:03:25,190 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39305,1694664063904 already deleted, retry=false 2023-09-14 04:03:25,190 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39305,1694664063904 expired; onlineServers=1 2023-09-14 04:03:25,190 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-14 04:03:25,191 INFO [RS:1;jenkins-hbase4:39261] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39261 2023-09-14 04:03:25,193 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39261,1694664063868 2023-09-14 04:03:25,193 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-14 04:03:25,194 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39261,1694664063868] 2023-09-14 04:03:25,194 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39261,1694664063868; numProcessing=3 2023-09-14 04:03:25,195 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39261,1694664063868 already deleted, retry=false 2023-09-14 04:03:25,195 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39261,1694664063868 expired; onlineServers=0 2023-09-14 04:03:25,195 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45157,1694664062520' ***** 2023-09-14 04:03:25,195 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-14 04:03:25,196 DEBUG [M:0;jenkins-hbase4:45157] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d9d152, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-14 04:03:25,196 INFO [M:0;jenkins-hbase4:45157] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45157,1694664062520 2023-09-14 04:03:25,196 INFO [M:0;jenkins-hbase4:45157] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45157,1694664062520; all regions closed. 2023-09-14 04:03:25,196 DEBUG [M:0;jenkins-hbase4:45157] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-14 04:03:25,196 DEBUG [M:0;jenkins-hbase4:45157] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-14 04:03:25,196 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-14 04:03:25,196 DEBUG [M:0;jenkins-hbase4:45157] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-14 04:03:25,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694664065183] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1694664065183,5,FailOnTimeoutGroup] 2023-09-14 04:03:25,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694664065183] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1694664065183,5,FailOnTimeoutGroup] 2023-09-14 04:03:25,196 INFO [M:0;jenkins-hbase4:45157] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-14 04:03:25,196 INFO [M:0;jenkins-hbase4:45157] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-14 04:03:25,196 INFO [M:0;jenkins-hbase4:45157] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-14 04:03:25,196 DEBUG [M:0;jenkins-hbase4:45157] master.HMaster(1512): Stopping service threads 2023-09-14 04:03:25,196 INFO [M:0;jenkins-hbase4:45157] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-14 04:03:25,197 ERROR [M:0;jenkins-hbase4:45157] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-14 04:03:25,197 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-14 04:03:25,197 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-14 04:03:25,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-14 04:03:25,197 INFO [M:0;jenkins-hbase4:45157] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-14 04:03:25,197 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-14 04:03:25,198 DEBUG [M:0;jenkins-hbase4:45157] zookeeper.ZKUtil(398): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-14 04:03:25,198 WARN [M:0;jenkins-hbase4:45157] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-14 04:03:25,198 INFO [M:0;jenkins-hbase4:45157] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-14 04:03:25,198 INFO [M:0;jenkins-hbase4:45157] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-14 04:03:25,199 DEBUG [M:0;jenkins-hbase4:45157] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-14 04:03:25,199 INFO [M:0;jenkins-hbase4:45157] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 04:03:25,199 DEBUG [M:0;jenkins-hbase4:45157] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 04:03:25,199 DEBUG [M:0;jenkins-hbase4:45157] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-14 04:03:25,199 DEBUG [M:0;jenkins-hbase4:45157] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 04:03:25,199 INFO [M:0;jenkins-hbase4:45157] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.93 KB heapSize=452.19 KB 2023-09-14 04:03:25,211 INFO [M:0;jenkins-hbase4:45157] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.93 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8b14edbf939f41709d2e128d98a25d73 2023-09-14 04:03:25,214 INFO [M:0;jenkins-hbase4:45157] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b14edbf939f41709d2e128d98a25d73 2023-09-14 04:03:25,215 DEBUG [M:0;jenkins-hbase4:45157] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8b14edbf939f41709d2e128d98a25d73 as hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8b14edbf939f41709d2e128d98a25d73 2023-09-14 04:03:25,218 INFO [M:0;jenkins-hbase4:45157] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b14edbf939f41709d2e128d98a25d73 2023-09-14 04:03:25,219 INFO [M:0;jenkins-hbase4:45157] regionserver.HStore(1080): Added hdfs://localhost:43181/user/jenkins/test-data/416ca03e-d669-a8ff-9600-a670d38eaa33/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8b14edbf939f41709d2e128d98a25d73, entries=119, sequenceid=899, filesize=28.7 K 2023-09-14 04:03:25,219 INFO [M:0;jenkins-hbase4:45157] regionserver.HRegion(2948): Finished flush of dataSize ~375.93 KB/384957, heapSize ~452.17 KB/463024, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=899, compaction requested=false 2023-09-14 04:03:25,221 INFO [M:0;jenkins-hbase4:45157] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-14 04:03:25,221 DEBUG [M:0;jenkins-hbase4:45157] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-14 04:03:25,223 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-14 04:03:25,224 INFO [M:0;jenkins-hbase4:45157] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-14 04:03:25,224 INFO [M:0;jenkins-hbase4:45157] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45157 2023-09-14 04:03:25,227 DEBUG [M:0;jenkins-hbase4:45157] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45157,1694664062520 already deleted, retry=false 2023-09-14 04:03:25,289 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 04:03:25,289 INFO [RS:2;jenkins-hbase4:39305] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39305,1694664063904; zookeeper connection closed. 2023-09-14 04:03:25,289 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39305-0x100a898aa680003, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 04:03:25,290 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c73057d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c73057d 2023-09-14 04:03:25,389 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 04:03:25,390 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): master:45157-0x100a898aa680000, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 04:03:25,390 INFO [M:0;jenkins-hbase4:45157] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45157,1694664062520; zookeeper connection closed. 2023-09-14 04:03:25,490 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 04:03:25,490 DEBUG [Listener at localhost/36207-EventThread] zookeeper.ZKWatcher(600): regionserver:39261-0x100a898aa680002, quorum=127.0.0.1:64527, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-14 04:03:25,490 INFO [RS:1;jenkins-hbase4:39261] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39261,1694664063868; zookeeper connection closed. 2023-09-14 04:03:25,490 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4a0a86d7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4a0a86d7 2023-09-14 04:03:25,490 INFO [Listener at jenkins-hbase4.apache.org/37059] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-14 04:03:25,491 WARN [Listener at jenkins-hbase4.apache.org/37059] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-14 04:03:25,493 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-14 04:03:25,596 WARN [BP-1201208726-172.31.14.131-1694664058943 heartbeating to localhost/127.0.0.1:43181] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-14 04:03:25,597 WARN [BP-1201208726-172.31.14.131-1694664058943 heartbeating to localhost/127.0.0.1:43181] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1201208726-172.31.14.131-1694664058943 (Datanode Uuid b119bc37-5c4b-477e-987c-a1a5c3e5424f) service to localhost/127.0.0.1:43181 2023-09-14 04:03:25,598 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data5/current/BP-1201208726-172.31.14.131-1694664058943] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 04:03:25,599 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data6/current/BP-1201208726-172.31.14.131-1694664058943] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 04:03:25,600 WARN [Listener at jenkins-hbase4.apache.org/37059] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-14 04:03:25,602 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-14 04:03:25,704 WARN [BP-1201208726-172.31.14.131-1694664058943 heartbeating to localhost/127.0.0.1:43181] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-14 04:03:25,705 WARN [BP-1201208726-172.31.14.131-1694664058943 heartbeating to localhost/127.0.0.1:43181] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1201208726-172.31.14.131-1694664058943 (Datanode Uuid f00e1b47-036c-44ce-a71d-a7926febf9bf) service to localhost/127.0.0.1:43181 2023-09-14 04:03:25,705 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data3/current/BP-1201208726-172.31.14.131-1694664058943] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 04:03:25,706 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data4/current/BP-1201208726-172.31.14.131-1694664058943] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 04:03:25,707 WARN [Listener at jenkins-hbase4.apache.org/37059] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-14 04:03:25,708 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-14 04:03:25,811 WARN [BP-1201208726-172.31.14.131-1694664058943 heartbeating to localhost/127.0.0.1:43181] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-14 04:03:25,812 WARN [BP-1201208726-172.31.14.131-1694664058943 heartbeating to localhost/127.0.0.1:43181] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1201208726-172.31.14.131-1694664058943 (Datanode Uuid 77154a63-f206-47e0-9c6d-7428f7944371) service to localhost/127.0.0.1:43181 2023-09-14 04:03:25,812 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data1/current/BP-1201208726-172.31.14.131-1694664058943] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 04:03:25,813 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/6dcfa325-f9fc-82d2-31ce-25b6211201fa/cluster_3496981e-990f-a15f-5604-4f3bb04a4ff4/dfs/data/data2/current/BP-1201208726-172.31.14.131-1694664058943] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-14 04:03:25,833 INFO [Listener at jenkins-hbase4.apache.org/37059] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-14 04:03:25,959 INFO [Listener at jenkins-hbase4.apache.org/37059] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-14 04:03:26,050 INFO [Listener at jenkins-hbase4.apache.org/37059] hbase.HBaseTestingUtility(1293): Minicluster is down